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MSIP 5 Overview 
| 


The fifth version of the Missouri School Improvement Program (MSIP 5), the state’s 
accountability system for reviewing and accrediting public school districts, outlines the 
expectations for student achievement with the ultimate goal of each student graduating ready for 
success in college, careers, and life. The comprehensive MSIP accountability system was 
established in 1990 and has evolved with each version. MSIP 5 Resource and Process Standards 
are designed to promote continuous improvement and innovation within each district. The 
Process Standards are often qualitative in nature. The MSIP 5 Performance Standards are 
designed to recognize the achievement and continuous growth of ALL students as they prepare 
for a global economy. 


MSIP 5 is also used to distinguish the performance of schools and districts in valid, accurate, and 
meaningful ways so that districts in need of improvement can receive appropriate support and 
interventions, and high-performing districts can be recognized as models of excellence. Annual 
Performance Reports (APRs) are based on the performance standards and are reviewed for 
accreditation purposes at the district level. The state also produces APRs for schools and charter 
local education agencies (LEAs) to support its goal of empowering all stakeholders in manners 
appropriate to their roles through regular communication and transparent reporting of results. 


The adopted MSIP 5 Standards represent the work of hundreds of educators. Numerous 
refinements and revisions were made before the State Board of Education approved the final 
changes. The standards will guide Missouri’s continuing school-improvement efforts. 


Nae Mod ee bi sl Bp a pel AD. rk 
1998 1996 2000. 2001 2005 2006 Rey "2012 tet 


Comprehensive Guide to MSIP 5 Page 2 


TABLE OF CONTENTS 


Performance Standards .....cccssccssessssscesesnsescacsescasensneesnansesaaesnsnansnaneesnaesusoassuanansnanencaasseseausnsnaesnansacaassnssansnnens 4 


Performance Standards for K-12 Districts........ccssssssssssssessssssssssseeeeeseeeesessecseeeesenanaeaeeeseeeeeeeeeeneeeeseseeenenananananenaess 6 
Performance Standards for K-8 Districts........cssssscssssssssssssessssssseeseeneneensesseeeseessenseaeaeseaeeeeeeeseeeeeeeseeesenenanananeneeess 8 
MSIP 5 Annual Performance Report ScCOring Guide.......sssssssssesesseeseeeessssessseessesencseseeeeeeeeeeeesseeeseeeeeeeseennsnaneeeess 9 
Changes to 2016 APR Calculation .n...ceseeeseessssssstesstessstessnecsstecsseesseesneessseecsecsnsecsseessuessneessseesaecsneesseeesseessneesnecsaeessuessneesaeesaneesneeeeaeesaeersneease 10 
MSIP 5 Performance Standard 1: Academic AchieVeme nt ........sessssesssecsstessssssstessstecseesseesneessteesseeesneesatecsessneeeaeesatersneesateesaneesaeesae 13 
MSIP 5 Performance Standard 2: Subgroup Achievement .......scessssssssecssessssssessstecsteecstecsneecateeeseessneesaseeaeesneeeateesaeessneesateesatessaeeaae 25 
MSIP 5 Performance Standard 3: Indicators 1-3 College and Career Readiness (CCR) (K-12 LEAs only) .........0.8 29 
MSIP 5 Performance Standard 3: Indicator 4 College and Career Readiness (CCR) (K-12 LEAs only)......ceeseeseeeen 34 
MSIP 5 Performance Standard 3: Indicators 5-6 College and Career Readiness (CCR) (K-12 LEAs only)...........8 39 
MSIP 5 Performance Standard 3: High School Readiness (HSR) (K-8 LEAS OnLy).....sseeessesssessteesstesssteeseessteeeateesneesseeeseeenneess 44 
MSIP 5 Performance Standard 4: Attendance Rate ....eseessssssseecssssssssneesstecsssecsseesneecsseesssssteesseersneesneeeseessessaeeesteesaeersneesnteesaeessneesae 47 
MSIP 5 Performance Standard 5: Graduation Rate...c..eessessssssseessessssssssessstessssecsseesseeeseesseesneesaeecsneesneesseesseeesaeeeateesaeeesneesateesaeeesaeesne 52 
MSIP 5 Generating the Annual Performance Report SCOPE .......ssssssseeseeeeeeeeteenenseeeeeeeeeeeeenes 58 
MSIP 5 Generating Performance Indicator Flags ........ssssssssssssseseeesesessseeseeesesanansnseseeeeeeeeeeeenseseeeseeneneaenennseseaes 61 
MSIP 5 2017 Annual Performance Report NoOteS.....sssssssssssssseessesesesssseseseeesensesseeeeeeesessseeseseeesesenenenrareeaes 62 
Performance RUDricS isc: coe 2 oe tecte cece ctscte coves eee ctectebencedeatecese eked deptetsetevestvciavis aestedenceclechacertecsdeonnan sd oe etatens 64 
PRIS NCES atescchnectnccincwanesnnscnaschneotnnehnsaiannennsnihesnicsantchndaanenindsenaihnauanshidannessiaseunhnsssuidslnasiid thusaandaandennnemnasincein cies 71 
Appendix A Top 10 by 20 Projected Status Targets ......:scsssssssssssssssssssssssseeeeeseecsssseseseeenenansnerereeseeeeneneesesenens 72 
Appendix. B ASseSsmeEnt Schedul Csconies.. sc ccsccecseccsnesecxee ctcoecsesccsssecsedceanse aves sceeccseensucutevecuctsceared eesercseunsexeiitecaecebendeare 79 
Appendix C Assessment Scores Matrix....ssssssssscsccsesssessssssesssnensnenseeeeeeeeesssesseseeneneneneneaseeseeesenanansseseeesneneaenenesesesens 80 
Appendix D Standard 3: College and Career Readiness*4 Scores Matrix ..scssssssssseeeeesessseseseessenenseees 81 
Appendix E Standard 3: College and Career Readiness*4 Dual Credit ........:scscssssessesesssssssssessnseeseeeeees 82 
Appendix F Standard 3: College and Career Readiness? 4 .......:ssssssssssssseseeseeeeesesseeeessesenaneeeeseeeeeeeeneeeeeneeeees 83 
Appendix G Career Education Placement/Follow-Up Guidelines .........ccsccscssssseeeseenenetsseeeseeeeesneeeeeeees 84 
Appendix H Type Of Appeals ic. :acacicicsnnsiessccendsecseenseesetetescessesnetsevertstensoenreesvecencenndaneventstensoenentassreevanneenaeestenccenenteen 85 
Appendix I Missouri Growth Model Technical DOCUMENTATION ..........cssececeeeeeeeeseseseeeeetensntnseeeeeeeenenenteneeees 87 
MOS SAD Y sis asceetccssares ccaceentiiczacentsasiessaiucsasiicarestentdaecusdstneadhausaidecesiinceti vensilestieedtiancadnadneiinetcnan deveined 99 


Comprehensive Guide to MSIP 5 Page 3 


vy 
= 7, 
- = 


ioe Oe : . j a 
all ©) 


Performance Standards 
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Overview 
mn 


The Department of Elementary and Secondary Education’s (DESE) Plan holds as a primary goal that all 
students will graduate high school college and career ready. To measure progress toward this goal and to 
distinguish among school and district performance, DESE computes an APR score for each LEA and 
school. This overall score is comprised of scores for each of the MSIP 5 Performance Standards 
Academic Achievement (2) Subgroup Achievement (3) High School Readiness (K-8 districts) or 
College and Career Readiness (K-12 districts), (4) Attendance Rate and (5) Graduation Rate (K-12 
districts). Status, progress, and growth (where applicable) are used to calculate a comprehensive score 
used to determine the accreditation level of a school district. 


Data for academic achievement (English language arts and mathematics), subgroup achievement (English 
language arts and mathematics) and graduation rate are also used for federal accountability 
determinations, including reward, focus, and priority school identification for LEAs and schools. 


The MSIP 5 Performance Standards were approved by the State Board of Education in December of 2011 
and went into effect in 2013. 
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Performance Standards for K-12 Districts 


1. Academic Achievement—The district administers assessments required by the Missouri Assessment 
Program (MAP) to measure academic achievement and demonstrates improvement in the 
performance of its students over time. 


1. Student performance on assessments required by the MAP meets or exceeds the state 
standard or demonstrates improvement in performance over time. 


2. The percent of students tested on each required MAP assessment meets or exceeds the state 
standard. 


3. Growth data indicate that students meet or exceed growth expectations. 


2. Subgroup Achievement—The district demonstrates required improvement in student performance 
for its subgroups. 


1. The performance of students identified on each assessment in identified subgroups, including 
free/reduced price lunch, racial/ethnic background, English language learners, and students 
with disabilities, meets or exceeds the state standard or demonstrates required improvement. 


3. College and Career Readiness—The district provides adequate post-secondary preparation for all 
students. 


1. The percent of graduates who scored at or above the state standard on any department- 
approved measure(s) of college and career readiness, for example, the ACT®, SAT®, 
COMPASS® or Armed Services Vocational Aptitude Battery (ASVAB), meets or exceeds the 
state standard or demonstrates required improvement. 


2. The district’s average composite score(s) on any department-approved measure(s) of college 
and career readiness, for example, the ACT®, SAT®, COMPASS®, or ASVAB, meet(s) or 
exceed(s) the state standard or demonstrate(s) required improvement. 


3. The percent of graduates who participated in any department-approved measure(s) of college 
and career readiness, for example, the ACT®, SAT®, COMPASS®, or ASVAB, meets or exceeds 
the state standard or demonstrates required improvement. 


4. The percent of graduates who earned a qualifying score or grade on an Advanced Placement 
(AP), International Baccalaureate (IB), or Technical Skills Attainment (TSA) assessments 
and/or receive college credit or a qualifying grade through early college, dual enrollment, or 
approved dual credit courses meets or exceeds the state standard or demonstrates required 
improvement. 


5. The percent of graduates who attend post-secondary education/training or are in the military 
within six months of graduating meets the state standard or demonstrates required 
improvement. 


6. The percent of graduates who complete career education programs approved by DESE and are 
placed in occupations directly related to their training, continue their education, or are in the 
military within six months of graduating meets the state standard or demonstrates required 
improvement. 
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4. Attendance Rate—The district ensures all students regularly attend school. 


1. The percent of students who regularly attend school meets or exceeds the state standard or 
demonstrates required inprovement. 


5. Graduation Rate—The district ensures all students successfully complete high school. 
1. The percent of students who complete an educational program that meets the graduation 


requirements as established by the board meets or exceeds the state standard or 
demonstrates required improvement. 
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Performance Standards for K-8 Districts 
| 


1. Academic Achievement—The district administers assessments required by the MAP to measure 
academic achievement and demonstrates improvement in the performance of its students over time. 


1. Student performance on assessments required by the MAP meets or exceeds the state 
standard or demonstrates improvement in performance over time. 


2. The percent of students tested on each required MAP assessment meets or exceeds the state 
standard. 


3. Growth data indicate that students meet or exceed growth expectations. 


2. Subgroup Achievement—The district demonstrates required improvement in student performance 
for its subgroups. 


1. The performance of students identified on each assessment in identified subgroups, including 
free/reduced price lunch, racial/ethnic background, English language learners, and students 
with disabilities, meets or exceeds the state standard or demonstrates required improvement. 

3. High School Readiness—The district provides adequate post-elementary preparation for all students. 

1. The percent of students who earn a proficient score on one or more of the high school End-of- 
Course (EOC) assessments while in elementary school meets or exceeds the state standard or 
demonstrates required improvement. 


4. Attendance Rate—The district ensures all students regularly attend school. 


1. The percent of students who regularly attend school meets or exceeds the state standard or 
demonstrates required improvement. 
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MSIP 5 Annual Performance Report Scoring Guide 


DESE’s Strategic Plan holds as a primary goal that all students will graduate high school college and 
career ready. To measure progress toward this goal and to distinguish among school and district 
performance, the Missouri Department of Elementary and Secondary Education (DESE) computes an APR 
score for each LEA and school. This overall score is comprised of scores for each of the MSIP 5 
Performance Standards (1) Academic Achievement, (2) Subgroup Achievement, (3) High School 
Readiness (K-8 districts) or College and Career Readiness (K-12 districts), (4) Attendance Rate, and 
(5) Graduation Rate (K-12 districts). Three distinct metrics focusing on status, progress, and growth 
(where applicable) are used to calculate a comprehensive score used to determine the accreditation level 
of a school district. 


Performance Standard 1 English Mathematice | Science Social 
Academic Achievement Language Arts Studies 
Points Possible 16 16 16 8 
Performance Standard 2 English Mathematics: (Scienee Social 
Subgroup Achievement Language Arts Studies 
Points Possible 4 4 4 2 


Performance Standard 3 (K-12 


7 KT 7 “k 7 *EL 
Districts) College & Career Readiness Indicators*1-3 Indicator*4 Indicators*5-6 


Points Possible 10 10 10 


Performance Standard 3 (K-8 Districts) 
High School Readiness 


Points Possible 10 


Performance Standard 4 
Attendance 


Points Possible 10 


Performance Standard 5 
Graduation 


Points Possible 30 


The detailed scoring guides for each performance standard are outlined in this section. The academic and 
subgroup achievement measures are based on the Missouri Assessment Program (MAP) grade-level 
(GLA), End-of-Course (EOC), and MAP-alternate (MAP-A) assessments. The high school readiness 
measure is based on the EOC assessments. Once new assessments aligned to Missouri’s Learning 
Standards are available and included in the MAP, DESE will reset the achievement targets accordingly. 
Performance and achievement targets will be reviewed and revised, if necessary, when new 
assessments are introduced and/or every three years. 
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oan to 2017 APR Calculation Changes 


1. English Language Arts and Mathematics Assessment Hold Harmless 


a. 
b. 


Standard Applicable: Standards 1 and 2 - English language arts (ELA) and Mathematics 
Updated Policy due to exclusion of Algebra I (A1) and English II (EZ) data: 
Administrative Memo: LS-17-002 
The 2017 APR will be calculated using existing 2015 and 2016 data plus 2017 data with Al and E2 
removed. The points earned in Standard 1 and 2 will be compared to the points earned in 2016. 
The district will receive the higher of 2016 or 2017 points for the APR. The same calculation 
process will be followed for Standard 1 Academic Achievement and Standard 2 Subgroup 
Achievement 
i. Example: An LEA receives 12 points in Standard 1 ELA in 2016, but earns 16 points in 
2017 (with Al and E2 data excluded). The 16 points for 2017 would be used in the APR 
calculation. The opposite is also true; if a district earned 16 points in 2016, but only 12 in 
2017, 16 points from 2016 would be used for the APR calculation. 
ii. Participation in Al and E2 during the 2017 accountability year satisfies the accountability 
requirement of assessing at the high school level in each assessment. Graduates will not 
receive an LND for A1 and E2 assessments taken in 2017. 


2. Calculation of Progress and Use of Normal Curve Equivalents (NCE) 


a. 
b. 


Cc. 
d. 


Standard Applicable: Standards 1 and 2 - English language arts (ELA) and Mathematics 
Updated Policy due to exclusion of Algebra I (A1) and English II (EZ) data: The 2017 APR will 
be calculated using existing 2015 and 2016 data plus 2017 data with A1 and E2 removed. DESE 
will use normal curve equivalents in the calculation of progress for ELA and mathematics. This 
statistical method, which measures student achievement along a normal curve, will be used in 
order to preserve the progress calculation throughout the transition in assessments. (Note: This 
policy does not apply to science and social studies within Standards 1 and 2, nor does it apply to 
Standards 3, 4, and 5. Progress within these standards will be calculated in the same manner as in 
years past and will include 2017 data.) 

More Information: Appendix I 


Sample Report: 


1. Academic Achievement 


Points Points 


Earned 


Percent | Metric 
Earned 


English Language Arts 


Status 16.0 9.0 
Progress 12.0 3.0 


af ons [a sr [oe al s1 


08 Approaching Prior 2 Yr NCE Avg = 49.0 Current 2 Yr NCE Avg = 49.8 


Growth 


12.0 


6.0 


0.0/N On Track | 


Total Points Earned - 2016 
(Status + Progress or Growth) 


16.0 


15.0 


Total Points Earned - 2014 


16.0 


3 Yr Progress = Average(Current NCE and Year 2 NCE) - Average(Year 2 NCE and Year 3 NCE) 


160 | 100.0% | 


3. Removal of Optional EOC (EOC) Assessments 


a. 
b. 


Standard Applicable: Standards 1 and 2 - All content areas 

Updated Policy: DESE has not included optional EOC assessments in prior year data to allow 
for equitable comparison and opportunity for progress. Optional EOCs include all EOC 
assessments beyond the four required (English II, American Government, Biology, and 
Algebra I, or if Algebra I taken prior to 9 grade, Algebra II). When excluding this data, DESE 
will not alter any prior year final APR totals. The adjusted data will only factor into the 
calculation of the 2015, 2016, and 2017 APR. Further, DESE does not penalize any LEA fora 
Level Not Determined (LND) designation that is created by the removal of optional EOCs from 
prior year data. However, the LND designation will not be modified for 2015 and 2016 data. 
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4. High School Readiness (K-8 LEA’s only) - Removal of A1 from a qualifying score 

a. Standard Applicable: Standard 3 High School Readiness (HSR) 

b. Updated Policy: The results from the 2017 EOCs in A1 and E2 do not produce year-to-year 
comparable results. For purposes of the 2017 APR, if a student was assessed on the A1 
assessment, DESE will substitute with a student’s prior year qualifying proficienct score on 
the 7 grade mathematics assessment in its place. (After analysis of the 2017 assessment data, 
it was determined that K-8 LEA’s did not administer the E2 assessment). 


5. Community Eligibility Provision (CEP) 

a. Standard Applicable: Standard 2: Subgroup Achievement 

b. Updated Policy: The implementation of the Community Eligibility Provision (CEP) will alter 
the method of calculating Standard 2: Subgroup Achievement for LEAs that elect to 
participate. These LEAs will no longer be collecting paperwork for students who are eligible 
for Free/Reduced Lunch (FRL), and as such, DESE will follow Federal guidance in accounting 
for CEP LEAs’ subgroup populations. While participating in CEP, the LEA’s super subgroup 
will be the same as the “all students” group. Missouri will continue to report data for students 
in the aggregate, as well as for the following subgroups: low-income students, students with 
disabilities, English learners (EL), and the state’s major racial and ethnic populations. 


6. Census Administration of the ACT for Grade 11 Students 
a. Standard Applicable: Standard 3*1-3: College and Career Readiness 
b. Updated Policy: As part of the Missouri Assessment Program, all students will receive the 
opportunity to produce a valid ACT score that can be used when applying to institutions of 
higher education. From an accountability perspective, DESE will report and weigh this newly 
collected data in the following manner: 

i. All grade 11 students who participate in the census administration will meet the 
participation requirement of Standard 3*1-3, earning at least 0.25 student weight 
upon graduation. 

ii. The 11th grade census ACT administration will produce two reportable items, a 
participation rate and an average composite score, that appear on the APR Summary 
Data page and the District Report Card. 

iii. When calculating the participation rate, the group of total will be composed of all 
grade 11 students minus any MAP-Alternate students and any EL students who have 
resided within the United States for less than a year. 

c. Sample Report: 


2014 2015 2016 
APR Total 135.0/140 127.5/140 124.0/140 
Points 
Percent of 96.4% 91.1% 88.6% 
Points 
MSIP 5 Standards Points Points Earned Percent Earned 

Possible 

1. Academic Achievement 56.0 49.0 —_¥_ wt 37.5% 
2. Subgroup Achievement 14.0 11.5 ee 82.1% 
3. College and Career Ready (CCR) 30.0 23.5 ee TE.3% 
4. Attendance 10.0 10.0 lll §=§6100.0% 
5. Graduation Rate 30.0 30.0 — re § 100.0% 
Total 140.0 124.0 ll 88.6% 


11th Grade ACT Census REPORTABLE 


2015 2016 
Participation Rate 98.2% 100.0% 
Avg. Composite Score 13.4 138.1 


7. Expansion of Career and Technical Education (CTE) 
a. Standard Applicable: Standard 3*4: College and Career Readiness 


Comprehensive Guide to MSIP 5 Page 11 


b. Updated Policy: For the 2017 APR, DESE will award additional points under Standard 3*4: 
College and Career Readiness for schools that create CTE opportunities. An LEA may receive 
two points toward the ten points possible in Standard 3*4 by creating and/or entering into a 
partnership with area career centers, comprehensive high schools, industry, or business to 
develop a pathway for students to accomplish each of the following: 

i. Enroll ina program of career and technical education while in high school; 
ii. Participate and complete an internship or apprenticeship during their final year of 
high school; 
iii. Obtain the industry certification or credentials applicable to their program or career 
and technical education and internship or apprenticeship. 


LEAs that provide for all three of the above objectives will receive the aforementioned two 
points under Standard 3*4. In order for LEAs to maintain these two points in consecutive 
years, the LEA must continue to expand their CTE program offerings each year, by continuing 
to grow the previously expanded program, expanding a separate program, or creating a new 
program in compliance with the stated criteria. Additionally, all LEAs that partner with an 
area career center or vocational school that has expanded or created CTE opportunities in 
alignment with the stated criteria will be eligible for the two additional points. Only programs 
whose application gained departmental approval will receive additional points on the 2017 


APR. 
c. More Information: See Administrative Memos LS-15-005, LS-15-007, and Section 162.1115 
RSMo. 


8. New SAT® Assessment 
a. Standard Applicable: Standard 3*1-3 College and Career Readiness 
i. Update: As of March 2016, the College Board began administering a new version of the 
SAT®. 
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MSIP 5 Performance Standard 1: Academic Achievement 


Academic Achievement — The district administers assessments required by the Missouri 
Assessment Program (MAP) to measure academic achievement and demonstrates improvement 
in the performance of its students over time. 
Student performance on assessments required by the MAP meets or exceeds the state standard 
or demonstrates improvement in performance over time. 


The percent of students tested on each required MAP assessment meets or exceeds the state 
standard. 
Growth data indicate that students meet or exceed growth expectations. 


ELA/Math Social ELA/Math Social 


2020 Target 8 Exceeding Exceeding 
On Track 12 6 On Track 6 3 On Track 6 
Approaching 9 5 Approaching 3 1.5 

Floor 0 
Floor 0 0 Floor 0 0 
Notes: 


e Data are obtained from contracted testing publishers for the grade-level assessment, EOC 
assessments and Missouri Assessment Program-Alternate (MAP-A) assessments. 

e Modified Hold Harmless policy applies to English language arts and mathematics. For more 
information, see page 10. 
All MAP performance data are reported to the nearest tenth. 

e Appendix H contains appeals procedures. 


STATUS MEASURES 

Status is a measurement of the LEA’s or school’s level of achievement based upon a three-year average of 
the MAP Performance Index (MPJ), unless three years of data are not available. When three years of data 
are not available for the LEA and/or school, (e.g. a new school is established) the available years will be 
used for reporting purposes. When three consecutive years of data are not available for the LEA and/or 
school, (e.g. participation rate not met in prior year), the three most recent years of data - not to exceed a 
time span of five years - will be used for accountability purposes. A detailed description of how to 
calculate the MPI can be found later in this document. The MPI is used to determine whether the LEA, 
school, or subgroup is meeting the 2020 target, is on track, is approaching, or is substantially not meeting 
(floor) the academic achievement target for English language arts, mathematics, science, and social 
studies MAP assessments. See the subsection on Cell Size for further considerations. 
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Status is divided into four levels as follows: 


e 2020 Target — represents a level of performance approximately equivalent to the projected 
2020 performance of the top 10 states on the corresponding National Assessment of Educational 
Progress (NAEP) exam OR, in subjects for which state-by-state NAEP data are unavailable, an 
equally rigorous target. 

e On Track — represents levels of increasing performance expectations with a goal of 75% 
proficient by the year 2020 - if Basic achievement is worth 300 points and Proficient achievement 
is worth 400 points, an MPI of 375 would result from 75% of students scoring at Proficient and 
25% scoring at Basic. Current performance is compared to this target, and then a linear trajectory 
is created that requires equal annual progress increments to reach the 2020 target. 

e Approaching — represents a level of performance equal to 100% Basic if each score at the Basic 
level yields 300 points. 

e Floor — represents a level of performance less than 100% Basic if each score at the Basic level 
yields 300 points. 


PROGRESS MEASURES 

The MPI is also used to measure annual improvement on the MAP assessments. This indicator holds LEAs 
and schools accountable for continuous improvement year to year using a rolling average, due to new 
assessments in English language arts and mathematics, the method of calculating Progress varies by 
content area. In science and social studies, the Progress calculation measures improvement by comparing 
two year averages of data and setting targets based on an MPI Gap. In English language arts and 
mathematics, the Progress calculation measures improvement by comparing two year averages of data 
and setting targets based on a NCE Gap. Year 1 and 2 are averaged, and years 2 and 3 are averaged; the 
averages are then compared to determine the amount of improvement achieved. When three years of 
data are not available in the LEA or school, (e.g., a new school is established) the available years will be 
used for reporting purposes. When three consecutive years of data are not available, (e.g., assessment 
data are not available one year for a content area), the three most recent years of data - not to exceed a 
time span of five years - will be used for accountability purposes. Progress in the LEA or school’s MPI or 
NCE recognizes movement of students throughout all MAP achievement levels, ensuring that the focus 
remains on all students and not just those closest to being proficient. Differentiated improvement targets 
are set for LEAs, schools, and subgroups based on the individual group’s two prior years’ achievement. A 
detailed description of how to calculate the MPI Gap and NCE Gap can be found later in this document. 


Progress is divided into four levels as follows: 


e Exceeding — represents equal to or greater than 5% improvement based on the MPI or NCE Gap. 

e On Track — represents equal to or greater than 3% but less than 5% improvement based on the 
MPI or NCE Gap. 

e Approaching — represents equal to or greater than 1% but less than 3% improvement based on 
the MPI or NCE Gap. 

e Floor — represents less than 1% improvement based on the MPI or NCE Gap. 


GROWTH MEASURES 

Growth is the change in achievement scores for an individual student between two or more points in 
time. While Progress measures the change in the performance of a defined group over time, Growth 
measures the achievement gains of individual students over time. 


Growth measures for MSIP 5 are determined by conducting a statistical analysis of all valid MAP score 
pairs from the prior three years. A valid MAP score pair is a score from grades 4 through 8 with a score 
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from the prior year and grade level. For example, a 4» grade score with a valid 34 grade score from the 
prior year, both for the same student, is a valid MAP score pair. In this case, the 4 grade score in the pair 
is the outcome score and the 3"4 grade score from the prior year is the predictor score. A 5‘ grade MAP 
score with no 4‘ grade score from the prior year would NOT be included in the statistical analysis 
because there is no valid predictor score to go with the outcome score. 


The statistical analyses determine the relationship between outcome scores and predictor scores across 
all LEAs and schools. This relationship is used to calculate a “predicted outcome score” for each score 
pair. The differences between the predicted outcome scores and the observed outcome scores (the 
“residuals”) from all the analyzed score pairs are then analyzed to determine each LEA or school “effect” 
on student achievement growth. 


A score pair is assigned to an LEA and school when the MAP test that generated the outcome score was 
taken in that LEA and school, regardless of the LEA and school where the exam that generated the valid 
predictor score was taken. An LEA or school growth measure (an “effect estimate”) is the average of the 
differences between observed and predicted scores from all test pairs assigned to the LEA or school. 


Current limitations in the assessment and related statistical analysis preclude developing a purely 
standards-based approach to evaluating the adequacy of student growth. A standards-based approach 
will be developed as Missouri transitions to new assessments. 


At this time, growth measures are only available for grades 4 through 8 in English language arts and 
mathematics. LEA and school growth measures are reported in NCE units on the APR. The state mean is, 
by construction, a score of 50 NCEs. LEA and school growth measures are compared to the state mean 
and those that are statistically different from the state mean will be noted. Statistical significance 
depends on three factors; the magnitude of the difference from the state mean, the number of score pairs 
analyzed for the LEA or school, and the overall variability in the individual student growth measures. 


Growth is divided into three levels as follows: 


e Exceeding — The LEA or school growth measure (effect) is greater than 50 AND the difference 
from 50 is statistically significant. 

e On Track — The LEA or school growth measure (effect) is not statistically different from 50. 

e Floor — The LEA or school growth measure (effect) is less than 50 AND the difference from 50 is 
statistically significant. 


TEST PARTICIPATION 

All LEAs and schools are required to assess at least 95% of their students and subgroups on the 
assessments required by the MAP. Zero APR points will be awarded to a content area for the aggregate or 
subgroup(s) for which the rate falls below 95%. 


English Learners (EL) Exclusion 

To meet the participation standard, ELs in their first year of U.S. schooling must participate in the state 
English Language Proficiency (ELP) assessment instead of English language arts assessment (grade level, 
EOC, MAP-A). ELs in their second year of U.S. schooling and beyond must participate in the appropriate 
mathematics, English language arts, science, and social studies assessment and the state ELP assessment. 
Exceptions to the ELP assessment requirement will be made only where accommodations for ELs with 
disabilities are not available for a particular test. 


MAP-Alternate (MAP-A) Exclusion 
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Some students with severe cognitive disabilities are not able to take the standard grade-level or EOC 
content area assessments. If the student’s Individualized Education Plan (IEP) team determines the 
student is unable to participate in the standard assessment, the student takes a MAP-A assessment. LEAs 
are required to assess all students who qualify for the MAP-A assessment on the corresponding MAP-A 
test; unless an alternate, assessment is not yet available. A student’s scorable MAP-A assessment in grade 
11 mathematics is used to meet the Algebra I EOC participation requirement, the English language arts 
grade 11 is used to meet the English II EOC participation requirement, the grade 11 science is used to 
meet the biology participation requirement. The LEA must use the MAP-A Exception code for the 
American government EOC assessment, as an alternate assessment is not yet available. However, a 
student would need to have consistently participated in MAP-A assessments previously before the MAP-A 
Exception code may be used by the LEA for this assessment. 


If the student’s IEP team determines the student is unable to participate in the standard assessment, the 
LEA is required to assess the student using a MAP-A assessment when available. There is no cap on the 
number of students who may participate in the MAP-A test. However, there is a 1% cap on proficient or 
advanced scores earned from the MAP-A which may be used in the LEA’s accountability determinations. 
The 1% cap is calculated at the LEA level and uses the tested population per subject area. LEAs that serve 
greater than 100 tested students will be restricted to the cap of 1% of their total tested population per 
subject area. LEAs that serve 100 or fewer tested students will be restricted to a cap not exceeding one 
student per subject area. LEAs with high percentages of students with cognitive disabilities may submit a 
Request for Exception to the Cap on Alternate Assessments. 


Full Academic Year (FAY) 

LEAs are required to test all enrolled students, unless the above specified EL or MAP-A Exclusion applies. 
All scores will be reported, but only scores of those students who have been enrolled a “Full Academic 
Year” (FAY) ina LEA and/or school will be included in the calculation for the APR score. A FAY is defined 
as any student who is enrolled from the last Wednesday in September through the MAP administration, 
without transferring out of the LEA or school for a significant period of time and re-enrolling. A 
significant period of time is considered “one day more than half of the eligible days between the last 
Wednesday in September and the test administration”. This information is obtained from the Missouri 
Student Information System (MOSIS) data reported by LEAs. This applies to each summary level 
independently. For example, a student who is coded as “in building less than a year” but was in the LEA a 
full academic year is excluded from the school totals but is included in the LEA totals. 


Participation Rate Calculation 

The participation rate calculates the percent of students who receive a valid MAP score in a subject or 
content area. A student for whom the district is accountable is an Accountable student. An Accountable 
student who receives a valid MAP score in a subject or content area is defined as a “Participant”. The 
number of “Participants” divided by the number of Accountable students is the participation rate. When 
an Accountable student does not receive a valid test score, the student receives a “Level Not Determined” 
(LND) in place of an achievement level score. The percent for LND may not exceed 5%, as all LEAs and 
schools are required to assess at least 95% of their students and subgroups on the assessments required 
by the MAP. If test data are not evaluated due to not meeting the minimum 95% participation rate, a 
symbol appears next to the subject area on the APR summary report. 


Step 1 - The number of Accountable students is determined. See definition regarding how to 
determine accountable students. 


Participants LND Students Accountable 
Students 
130 + 2 132 
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Step 2 - The Participation Rate is determined. Participants divided by accountable students = 
“Participation Rate” rounded to the tenth. 


Participants Accountable Students *Participation Rate 


130 / 132 98.5% 
*No points are awarded for test data if the participation rate falls below 95%. 


Definitions 


A student for whom the district is accountable to assess is an Accountable 


student. 

seo Ne Note: MAP scores are comprised from grade-level, MAP-A and EOC 
assessments. 

Participant An Accountable student who receives a valid MAP score in a subject or 
content area. 

Reportable Number of students with an Achievement Level for the content area 


excluding applicable exceptions. 


Number of students without an Achievement Level or an attempt on any 
Level Not Determined session on the test. 


(LND) Note: Graduating seniors that have not participated in all required 
assessments will receive the applicable LND. 

*MAP-A students with a scorable MAP-A assessment in a tested grade level are assigned an 
Achievement Level. 


CELL SIZE 

LEAs, schools, and the super subgroup (Standard 2: Subgroup Achievement) must have at least 30 
Accountable students in the group being measured in a given content area each year over a three year 
period in order to generate scores for accountability based on the average of three annually-calculated 
MPIs. If this is not possible, the Status measure is calculated by “pooling” three years of data and 
summing the number of accountable students and the numbers of students in each achievement level 
across the three year period; the “pooled” count is used in the calculation for determining Status and is 
referred to as the cumulative measure. 


This flowchart explains the conditions triggering special cell size decisions for Standard 1: Academic 
Achievement and Standard 2: Subgroup Achievement. 


Cell Size Is the cell size greater Calculate Status using three-year 
than 30 in each of the average MPI and calculate Progress 


three years available? with available three years of data 


Is the cell size greater Calculate Status using three year 

than 30 cumulative in cumulative (pooled) MPI and calculate 
all three years Progress with available three years of 
available? data 
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Standard 1: Academic Achievement 
Calculate Status using three year cumulative 
(pooled) MPI and calculate Progress with 


available three years of data 

Standard 2: Subgroup Achievement 

No points awarded or possible for super 
subgroup achievement in the given content 
area 


MEASURING MAP 


The MAP Performance Index (MPI) is used to develop scores within the Status and Progress metrics and 
to set academic achievement targets for LEA, school and student group achievement. Student 
performance on tests administered through the MAP is reported in terms of four achievement levels 
(Below Basic, Basic, Proficient and Advanced) that describe a pathway to proficiency. The MPI is a single 
composite number that represents the MAP assessment performance of every student by awarding points 
to each student based on the four achievement levels. The points for all students in the LEA, school or 
student group in a subject area are summed together, divided by the number of students in the group 
being measured and then multiplied by 100 rounded to the tenth. The result is the MPI for that group and 
subject. All assessment results from a single accountability year and for a single subject/content area are 
combined when generating the LEA, school or student group MPI. 


MPI Point Values 
Numeric values are assigned to each of the achievement level scores as follows: 


Achievement Level Index Point Value 
Below Basic 1 
Basic 3 
Proficient 4 
Advanced 5 


Assigning one point to the Below Basic achievement level and three points for the Basic achievement level 
supports Missouri’s expectation of placing every child on a path towards Proficiency. The additional 
point spread is designed to recognize, through year-to-year improvement in the MPI, the movement of 
students from this least desirable achievement level. The use of the index also allows for distinction 
between the Proficient and Advanced student, holding LEAs and schools accountable for continuous 
improvement beyond proficiency. 


MPI Example Calculation 


Achievement levels are provided by the testing companies for the total number of Reportable Students in 
each subject area. In the following example of a single content area for a grade 6 through 8 school, 

achievement levels generated through the grade-level MAP, the MAP-A, and the EOC assessments may be 
utilized. To generate the MPI, the number of Advanced scores are multiplied by five, Proficient scores by 
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four, Basic scores by three, and Below Basic scores by one. These products are then summed, divided by 
the total number of reportable and multiplied by 100 then rounded to the tenth to produce the MPI which 
ranges from 100-500. The following example shows how the index is calculated in a single subject and 
school: 


Step 1 - The number of students in each achievement level is determined for each year. 


Number Reportable Total 
Grade6 Grade7 Grade8 EOC MAP-A Reportable 
Below Basic 10 5 5 0 = 20 
Basic 10 10 15 0 = 35 
Proficient 5 10 15 9 iL = 40 
Advanced 15 8 5 2 = 30 
Total Reportable = 125 


Step 2 - The index point value assigned to each achievement level is multiplied by the number of 
students in each achievement level. 


Achievement Level Index Point Value # of Students Index Points 
Below Basic 1 = 20 = 20 
Basic 3 a 35 = 105 
Proficient 4 = 40 = 160 
Advanced 5 = 30 - 150 
Total 125 435 


Step 3 - The total index points is divided by the total number of reportable students and 
multiplied by 100 rounded to the tenth. 


Reportable 
Students sis 


435 / 125 = 3.48 * 100 348 


Total Index Points 


The same method is used when calculating at the LEA level. 


Step 1 - The number of students in each achievement level is determined for each year. 


Gr3 Gr4 GrS Gr6 Gr7 Gr8 EOC MAP-A Fotal 
Reportable 
Below Basic 5 8 7 10 5 5 5 = 45 
Basic 12 10 8 10 10 15 15 = 80 
Proficient 17 20 14 5 10 25 25 2 - 118 
Advanced 10 11 10 15 10 5 15 1 = 77 
Total Reportable 320 


Step 2 - The index point value assigned to each achievement level is multiplied by the number of 
students in each achievement level. 


Achievement Level Index Point Value # of Students Index Points 
Below Basic 1 = 45 = 45 
Basic 3 ai 80 - 240 
Proficient 4 e 118 = 472 
Advanced 5 * 77 = 385 
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Total 320 1,142 


Step 3 - The total index points is divided by the total number of Reportable Students and 
multiplied by 100 rounded to the tenth. 


Total Index Points Reportable MPI 
Students 
1,142 i 320 = 3.569 - 100 356.9 


Status Measure Calculation 


The MPI is used to determine whether the LEA, school, or subgroup is meeting the 2020 target, is on track 
to meeting the target, is approaching or is substantially not meeting (floor) the academic achievement 
targets set for the MAP content area. Using three years of data, this indicator holds LEAs and schools 
accountable for student performance in relation to statewide academic achievement targets. 


Example: Using three years of data to calculate the three year MPI for “ABC” LEA population for 
mathematics. 


Year 1 Year 2 Year 3 3-year MPI 
MPI MPI (most recent year) MPI Status 
354.2 + 356.9 + 360.1 = 1,071.2 /3 357.1 


In this example, the MPI for mathematics from Year 1, Year 2, and Year 3 are averaged and the mean is 
used to determine whether the LEA, school or subgroup is meeting or exceeding the 2020 target, is on 
track to meeting the target, and is approaching or is substantially not meeting (floor) the academic 
achievement target. The three year MPI status and the corresponding designation of 2020 target/on 
track/approaching are then used to assign points (e.g., a “score”) to each standard. For example, if a 357.1 
three year MPI = is “On Track” in mathematics, the LEA, school or subgroup would receive 12 Status 
Points for mathematics. 


Table 1. Standard 1: Academic Achievement Status Scores 


English Language Arts: Mathematics: Science: Social Studies: 


Grades 3-8 MAP, 
MAP-A, Alg I (2017 
excluded), Alg II!, Geo? 


Academic Grades 3-8 MAP, 
Achievement MAP-A, Eng. II (2017 excluded) 


Grades 5, 8 MAP, 


MAP-A, Biology US Government 


Status 2020 Target = 16 2020 Target = 16 2020 Target = 16 2020 Target = 8 

(Three year On Track = 12 On Track = 12 On Track = 12 On Track . 6 

average) Approaching = 9 Approaching = 9 Approaching = 9 Approaching = 5 
Floor = 0 Floor = 0 Floor = 0 Floor = 0 


1 Assessment used for accountability purposes when Algebra I EOC has been completed prior to 9t grade. 
2 Assessment used for accountability purposes when Algebra I and Algebra II EOCs have been completed prior to 9 grade. 
3The 2017 APR will be calculated with Al and E2 excluded from the 2017 MPI 


Progress Measure Calculation 
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Beginning in 2016, the MPI and NCE will be used to measure annual improvement for EL and 
mathematics assessments. This indicator holds LEAs and schools accountable for continuous 
improvement in the LEA, school or subgroup year to year using a rolling average. It recognizes movement 
of scores throughout all MAP achievement levels, ensuring that the focus remains on all students and not 
just those closest to being proficient. Differentiated improvement targets are set for LEAs, schools, and 
subgroups based on the individual group’s two prior years of achievement. In science and social studies 
contents, the average MPI for Years 1 and 2 is subtracted from a constant set at a 450 MPI to determine 
the MPI Gap. Due to new Missouri Learning Standards-aligned English language arts and mathematics 
assessments, the MPI totals within these contents are converted to an NCE and subtracted from a 
constant set at a 130 NCE to determine the NCE Gap. 


Example: Calculating the progress measure for “ABC” school district based on a rolling average of NCE 
and MPI, the following example shows how the progress measure is calculated across two subjects, one 
NCE-based and one MPI-based, at the LEA level: 


ABC District: ELA Year 1 Year 2 teers 
(most recent year) 
NCE 51.4 54.8 44.8 
ABC District: Science Year 1 Year 2 ear 4 
(most recent year) 
MPI 358.1 346.6 365.3 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to 
the tenth. 


ELA (NCE): (51.4 + 54.8) /2=53.1 


Science (MPI): (358.1 + 346.6) / 2 = 352.4 
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Step 2 - The average NCE/MPI for Years 1 and 2 is subtracted from the constant to determine 
the NCE/MPI Gap. 


Constant Years 1 and 2 Average Gap 
ELA (NCE): 130 - 53.1 = 76.9 
Science (MPI): 450 - 352.4 = 97.6 


Step 3 - The NCE/MPI Gap is used to establish Progress Targets as determined by multiplying 
the NCE/MPI Gap by the associated percentage, e.g. 5% for exceeding, 3% for on track, 1% for 
approaching. 


Table 2. Generating Targets for Progress Measure 


ELA (NCE) 
— Years 1 and 2 Years 2 and 3 Average 
NEE GOP. oe . Average NCE Progress Target 
Needed 8 8 8 
Exceeding 76.9 * 5% = 3.8 53.1 56.9+ 
On Track 76.9 * 3% = 2.3 53.1 55.4-56.8 
Approaching 76.9 * 1% = 0.8 53.1 53.9-55.3 
Science (MPI) 
MPI 
Years 1 and 2 Years 2 and 3 Average 
MEYGen Inenease Average MPI Progress Target 
Needed 8 8 8 
Exceeding 97.6 * 5% = 4.9 352.4 357.3-500 
On Track 97.6 * 3% = 2.9 352.4 355.3-357.2 
Approaching 97.6 * 1% = 1.0 352.4 353.4-355.2 


Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to 
the tenth. 


ELA (NCE): (54.8 + 44.8) /2=49.8 


Science (MPI): (346.6 + 365.3) / 2 = 356.0 
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Step 5 - Subtract the Years 1 and 2 (prior two year) average from the Years 2 and 3 (current two 
year) average to determine the minimum increase needed to meet each target level. 


ELA (NCE): 49.8 - 53.1 = -3.3 
Science (MPI): 356.0 - 352.4 = 3.6 


Step 6 - The district’s Years 2 and 3 average is compared to the district’s Years 1 and 2 average to 
determine if the district is exceeding, on track, or approaching the required increase. In the ELA 
(NCE) example, the ABC school district has a Year 2 and 3 average NCE of 49.8, a decrease of 3.3 
NCE from the Year 1 and 2 average NCE, which means that it is designated as “Floor” with the 
improvement benchmark and subsequently receives zero (0) points as its Progress Score in 
English language arts. In the Science (MPI) example, the ABC school district has a Year 2 and 3 
average MPI of 356.0, an improvement of 3.6 MPI from the Year 1 and 2 average MPI, which 
means that it is designated as “On Track” with the improvement benchmark and subsequently 
receives six points as its Progress Score in science. 


Table 3. Standard 1: Academic Achievement Progress Scores 


English Language Arts: | Mathematics: Science: Social Studies: 
Grades 3-8 MAP, 
Academic Grades 3-8 MAP, MAP-A, Alg I(2017 Grades 5, 8 MAP, 
Achievement MAP-A, Eng II(2017 excluded) — excluded) MAP-A, Biology eee 
Alg II1, Geo2 
Exceeding = 12 Exceeding = 12 Exceeding = 12 Exceeding = 6 
Bivaerese On Track = 6 On Track = 6 On Track = 6 On Track = 3 
8 Approaching = 3 Approaching = 3 Approaching = 3 Approaching = 1.5 
Floor = 0 Floor = 0 Floor = 0 Floor = 0 


1 Assessment used for accountability purposes when Algebra I EOC has been completed prior to 9th grade. 
2 Assessment used for accountability purposes when Algebra I and Algebra II EOCs have been completed prior to 9th grade. 
3The 2017 APR will be calculated with A1 and E2 excluded from the 2017 MPI 


Growth Measure Calculation 

Growth measures in English language arts and mathematics grades 4 through 8 are calculated using a 
Missouri Growth Model and included as a Growth Score that may be used in place of the LEA, school or 
student group Progress Score. Using statistical methods, the Missouri Growth Model estimates the 
systemic contributions of LEAs and schools on student growth. For a full description, see Missouri 
Growth Model in Appendix I. 
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Table 4. Growth Scores 


English Language Arts: Mathematics: 


Academic Grades 4-8 MAP, Grades 4-8 MAP, 

Achievement MAP-A MAP-A 
Exceeding = 12 Exceeding = 12 

Growth On Track = 6 On Track = 6 


(Grades 4-8) Fisor=0 Floor = 0 


If the LEA (for the LEA report) or school (for the school report) Growth Score is positive and a statistically 
significant score in mathematics, that Growth Score would earn 12 Growth Points in mathematics. 
Progress or Growth points, whichever is higher, is applied to the Academic Achievement score. 


The Status and Progress or Growth methods are applied to each subject (where applicable). The method 
awarding the maximum total points from Status + Progress or Growth is used for each subject area. The 
maximum amount of points that can be earned per subject area cannot surpass the points allocated for 
Status Points “2020 Target”, e.g. 16 for English language arts or eight for social studies. 
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MSIP 5 Performance Standard 2: Subgroup Achievement 


Subgroup Achievement — The district demonstrates required improvement in student 


performance for its subgroups. 
1. The performance of students identified on each assessment in identified subgroups, including 
free/reduced price lunch, racial/ethnic background, English language learners, and students 
with disabilities, meets or exceeds the state standard or demonstrates required improvement. 


ELA/Math Social ELA/Math Social 


2020 Target Exceeding 3 Exceeding 
On Track 3 1.5 On Track 2 1 On Track 2 
Approaching 2 1 Approaching 1 0.5 

Floor 0 
Floor 0 0 Floor 0 0 
Notes: 


e Data are obtained from contracted testing publishers for the grade-level assessment, EOC 
assessments and Missouri Assessment Program-Alternate (MAP-A) assessments. 

e Hold Harmless policy applies to English language arts (ELA) and mathematics. For more 
information, see page 10. 

e For LEAs or buildings participating in the Community Eligibility Provision (CEP), the super 
subgroup population will be the same as the “all students” population. 

e All MAP performance data are reported to the nearest tenth. 
Standard 2: Subgroup Achievement calculates the percent proficient or advanced and the MAP 
Performance Index (MPI) by subject area for students who are included in the super subgroup. 

e Individual subgroup data are available in the Missouri Comprehensive Data System Portal 
(MCDS). 


SUPER SUBGROUP 

To better differentiate among needs of the LEAs or schools and to ensure broader inclusion of students 
whose subgroups have historically performed below the state total, Missouri will continue to issue and 
report academic achievement for students in the aggregate and for low income students, students with 
disabilities, English language learners, and the state’s major racial and ethnic subgroups. A review of 
Missouri data identifies five significant gaps in subgroup performance (Black, Hispanic, low income 
students, students with disabilities and English learners). For state accountability determinations (e.g. 
District Accreditation), a super subgroup comprised of these five subgroups is used. A student who is 
included in one or more of the five identified subgroups is included as a single count in the super 
subgroup calculation. 


In the example below, all ten students’ scores are included in Standard 1: Academic Achievement in the 
group of total for accountability and reporting purposes when the cell size requirement is met (see cell 
size description for actual cell size requirements of 30). 


For Standard 2: Subgroup Achievement, a student who is included in one or more of the five identified 
subgroups, such as students B, C, D, E, and G, are only included once (unduplicated count) in the super 
subgroup calculation when the cell size requirement is met. 
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P< | P< | P< | P< | P< | BS | P< | P< |< | OS 


Performance of individual subgroups is reported for planning purposes. For example, Student B’s score 
would be reported in the group of Total, White, FRL, and IEP. 


CELL SIZE 

LEAs, schools, and the super subgroup (Standard 2: Subgroup Achievement) must have at least 30 
Accountable students in the group being measured in a given content area each year over a three year 
period in order to generate scores for accountability based on the average of three annually-calculated 
MPIs. If this is not possible, the Status measure is calculated by “pooling” three years of data and 
summing the number of Accountable students and the numbers of students in each achievement level 
across the three year period; the “pooled” count is used in the calculation for determining Status and is 
referred to as the cumulative measure. 


This flowchart explains the conditions triggering special cell size decisions for Standard 1 and 2: 


Cell Size Is the cell size greater Calculate Status using three-year 
than 30 in each of the average MPI and calculate Progress 


three years available? with available three years of data 


Is the cell size greater Calculate Status using three year 

than 30 cumulative in cumulative (pooled) MPI and calculate 
all three years Progress with available three years of 
available? data 


Standard 1: Academic Achievement 

Calculate Status using three year cumulative (pooled) MPI and 
calculate Progress with available three years of data 

Standard 2: Subgroup Achievement 

No points awarded or possible for super subgroup achievement 
in the given content area 
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STATUS, PROGRESS AND GROWTH MEASURES 

The super subgroup measures for Status, Progress, and Growth are calculated through the same 
methodology used to compute the LEA or school-level Standard 1: Academic Achievement scores as 
described starting on page 23. This includes measures of MPI calculations for science and social studies, 
NCE calculations for English language arts and mathematics, test participation, MAP-A exclusions, EL 
exclusions and full academic year. 


The Status targets for Standard 2: Subgroup Achievement are established based on cutting the 
achievement gap in half. The amount of points granted for 2020 target, on track, approaching, or falling 
significantly below the target (floor), is displayed in Tables 5 and 6. 


The same conceptual and statistical framework used to generate growth measures for Academic 
Achievement applies to the growth estimates generated for Subgroup Achievement. However, since the 
Growth Measure for Subgroup Achievement compares the average Growth of students in a district or 
school’s super subgroup to that of the state non-super subgroup, Growth Measures for Subgroup 
Achievement must be interpreted in a different manner. 


Subgroup growth measures are reported in NCE units on the APR. Growth measures that are statistically 
different from the state average growth of the non-super subgroup will be noted. Super subgroup growth 
will earn APR growth points as described below. 


Growth is divided into three levels as follows: 


e Exceeding — The LEA or school growth measure (effect) is greater than 50 AND the difference 
from 50 is statistically significant. 

e On Track — The LEA or school growth measure (effect) is not statistically different from 50. 

e Floor — The LEA or school growth measure (effect) is less than 50 AND the difference from 50 is 
statistically significant. 
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Table 5. Standard 2: Subgroup Achievement Status and Progress Scores 


English Language Arts: Mathematics: Science: Social Studies: 
Subgroup Grades 3-8 MAP, Grades SAY) Grades 5, 8 MAP 
: MAP-A, Eng II(2017 MAP-A, Alg (2017 A Bi , US Government 
Achievement excluded) euctuded), Ale It, Geo? MAP-A, Biology 
Stati 2020 Target = 4 2020 Target = 4 2020 Target = 4 2020 Target = 2 
(ayean On Track = 3 On Track = 3 On Track = 3 On Track = 1.5 
ais e) Approaching = 2 Approaching = 2 Approaching = 2 Approaching = 1 
8 Floor = 0 Floor = 0 Floor = 0 Floor = 0 
Exceeding = 3 Exceeding = 3 Exceeding = 3 Exceeding = 1.5 
Pracees On Track = 2 On Track = 2 On Track = 2 On Track = 1 
8 Approaching = 1 Approaching = 1 Approaching = 1 Approaching = 0.5 
Floor = 0 Floor = 0 Floor = 0 Floor = 0 


1 Assessment used for accountability purposes when Algebra I EOC has been completed prior to 9t" grade. 
2 Assessment used for accountability purposes when Algebra I and Algebra II EOCs have been completed prior to 9th grade. 
3The 2017 APR will be calculated with Al and E2 excluded from the 2017 MPI 


Table 6. Standard 2: Subgroup Achievement Growth Scores 


English Language Arts: Mathematics: 


Subgroup Grades 4-8 MAP, Grades 4-8 MAP, 

Achievement MAP-A, MAP-A 
Exceeding = 3 Exceeding = 3 

Grewal On Track = 2 On Track = 2 


(Grades 4-8) Fankeo Floor = 0 


The Status and Progress or Growth methods are applied to each subject (where applicable). The method 
awarding the maximum total points from Status + Progress or Growth is used for each subject area. The 
maximum amount of points that can be earned per subject area cannot surpass the points allocated for 
Status Points “2020 Target”, e.g. four for English language arts or two for social studies. 
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MSIP 5 Performance Standard 3: Indicators 1-3 
College and Career Readiness (CCR) (K-12 LEAs only) 
 —— 


College and Career Readiness (K-12 Districts) — The district provides adequate post-secondary 
preparation for all students. 

1. The percent of graduates who scored at or above the state standard on any department- 
approved measure(s) of college and career readiness, for example, the ACT®, SAT®, COMPASS®, 
or Armed Services Vocational Aptitude Battery (ASVAB), meets or exceeds the state standard 
or demonstrates required improvement. 


The district’s average composite score(s) on any department-approved measure(s) of college 
and career readiness, for example, the ACT®, SAT®, COMPASS®, or ASVAB, meet(s) or exceed(s) 
the state standard or demonstrate(s) required improvement. 

The percent of graduates who participated in any department-approved measure(s) of college 
and career readiness, for example, the ACT®, SAT®, COMPASS®, or ASVAB, meets or exceeds the 
state standard or demonstrates required improvement. 


2020 Target 10 Exceeding 7.5 
On Track 7.5 On Track 4 
Approaching 6 Approaching 2 
Floor 0 Floor 0 


Notes: 


e Data are obtained from the MOSIS June Enrollment and Attendance file and from official 
testing companies (ACT®, SAT®, COMPASS®, and ACT WorkKeys®) for scores on 
department-approved measures of college and career readiness. 

e ASVAB data are reported by the LEA through MOSIS submission. 

e When students take multiple types of tests and/or a single test multiple times, the 
highest score is used for the APR calculation. 

e ACT®, SAT®, COMPASS®, ACT WorkKeys®, and ASVAB weighted scores are available in 
Appendix C - “CCR*1-3 Assessment Scores Matrix”. 

e All grade 11 students are given an opportunity to participate in the census 
administration of the ACT®.MAP-A and EL students, in the United States for less than a 
year, are not included in census administration of the ACT®. All participants will 
receive at least a 0.25-weighted score per Appendix C. 

e The 2017 APR will be the last year for COMPASS inclusion in the APR. 

e New SAT® Assessment - Standard Applicable: Stand 3*1-3 College and Career 
Readiness. Update: As of March 2016, the College Board began administering a new 
version of the SAT®. 
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Example of supporting data format for APR: 


Year 1 Year 2 ERS Status 
most recent 


ine Number of graduates 
foes sine Scoring at or Above 87 98.5 110.25 
cabee the State Standard 
company 


Percent of graduates 
Scoring at or Above 58.8 64.4 71.1 64.8 
the State Standard 
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Method for calculating number of students at or above the state standard: 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


Approximate equivalent scores 
are used to establish 
comparability of scores on 
different assessments. A matrix 
of approximately equivalent 
CCR*1-3 assessment scores 
(Appendix C) displays SAT®, 
COMPASS®, ACT WorkKeys®, 
and ASVAB exams and their 
approximately equivalent ACT 
scores. Scores on the ACT® are 
used as reported. ACT® scores 
and approximately equivalent 
scores derived from other 
assessments must be equal to 
or greater than the ACT® 
anchor score in order to be 
included in the number of 
students scoring at or above 
the state standard. The exam 
contributing the highest 
approximate equivalent score is 
used for each student. 


Unduplicated Count 


a) number of graduates who 
score at or above a 26 on 
the ACT® or who 
demonstrate comparable 
performance ona 
department-approved 
measure multiplied by 1.25 


b) number of graduates who 
score at or above a 22 on 
the ACT® but below a 26 or 
who demonstrate 
comparable performance 
on a department-approved 
measure multiplied by 1 


c) number of graduates who 
score at or above an 18 on 
the ACT® but below 22 or 
who demonstrate 
comparable performance 
on a department-approved 
measure multiplied by 0.75 


d) number of graduates who 
participate in a department 
approved measure of 
college and career 
readiness but score below 
comparable performance 
of an 18 on the ACT® 
multiplied by 0.25 


e) number of graduates 
without a score multiplied 
by zero 


a) 18 *1.25 = 22.5 


b) 43*1=43 


c) 52* 0.75 =39 


d) 23 * 0.25 = 5.75 


e) 19*0=0 


Number of graduates scoring at 
or above the state standard 


22.5 +43 +39+45.75+0=110.25 


-Refer to Appendix C for the CCR*1-3 Assessment Scores Matrix 
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Method for calculating status: 
The percent of graduates scoring at or above state standard is determined by dividing the number of 

graduates scoring at or above the state standard by the number of graduates, then multiplying by 100 
rounded to the tenth. 


Explanations of Data 


Examples of Data 


Examples of 
Calculations 


1) 


The number of graduates is based on 
June Enrollment and Attendance 
Records with an Exit Code indicating 
the student graduated. 


number of graduates 


155 


2) 


The number of graduates scoring at 
or above the state standard is 
provided by the testing companies 
supplying approved assessment data; 
ASVAB data are provided by LEAs 
through MOSIS. 


number of graduates scoring 
at or above the state standard 


110.25 


3) 


The percent of graduates scoring at 
or above the state standard is 
determined by dividing the number 
of graduates scoring at or above the 
state standard by the number of 
graduates, then multiplying by 100 
rounded to the tenth. 


a) number of graduates 
scoring at or above the 
state standard = 110.25 


b) number of graduates = 155 


a) 110.25 /155 =0.711 


b) 0.711 * 100 = 71.1% 


4) 


Status is determined by adding Year 
1, Year 2, and Year 3 of the percent of 
graduates scoring at or above the 
state standard, dividing by three 
(unless three years of data are not 
available), and rounding to the tenth. 


(Year 1+ Year 2 + Year 3) /3 


58.8 + 64.4 + 71.1 = 194.3 


194.3 /3 = 64.8% 


Method for calculating Progress: 


Differentiated improvement targets are set for a given LEA or school based on the two prior years’ 
performance of that LEA or school. 


Example: Calculating the Progress measure for “ABC” school district, the following example shows how 


the Progress measure is calculated at the district level using a rolling average: 


ABC District Year 1 Year 2 ‘ale 
(most recent year) 
Percent of students scoring at or 
above state standard ae om ie 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to 


the tenth. 


(58.8 + 64.4) /2= 61.6 
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Step 2 - The average percentage for Years 1 and 2 is subtracted from 100 to determine the 


CCR*1-3 Gap. 
Years 1 and 2 os 
Constant Average Percent CCR*1-3 Gap 
100 - 61.6 = 38.4 


Step 3 - The CCR*1-3 Gap is used to establish Progress Targets as determined by multiplying the 
CCR*1-3 Gap by the associated percentage, e.g. 25% for exceeding, 15% for on track, 5% for 
approaching. 


Table 7. Generating Targets for Progress Measure 


Percent Years 1 and 2 Years 2 and 3 
Increase Average Average Progress 
*4- 
Cech Ts Sap Needed Percent Target 
Exceeding 38.4 : 25% = 9.6 61.6 71.2-100 
On Track 38.4 : 15% = 5.8 61.6 67.4-71.0 
Approaching 38.4 * 5% = 1.9 61.6 63.5-67.2 


Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to 
the tenth. 


(64.4 +711) /2=67.8 


Step 5 - The district’s Years 2 and 3 average percentage is used to determine if the district is 
exceeding, on track, or approaching the required percent increase. In the example above, the ABC 
school district has a Year 2 and 3 average percentage of 67.8, which means that it is designated as 
“On Track” (67.4-71.0 range) with the Progress Target and subsequently receives four points as 
its Progress Score in CCR*1-3. 


Table 8. Computing the College and Career Readiness*1-3 Score 


Status Progress 
2020 Target = 10 Exceeding = 7.5 
: F On Track = 7.5 On Track = 4 
Reins Possible Approaching = 6 Approaching = 2 
Floor = 0 Floor = 0 


College and Career Readiness Total: Maximum often points per indicator area for Status + Progress 
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MSIP 5 Performance Standard 3: Indicator 4 
College and Career Readiness (CCR) (K-12 LEAs only) 


—EEEE—————————EEE li) 


College and Career Readiness (K-12 Districts) — The district provides adequate post-secondary 
preparation for all students. 
4. The percent of graduates who earned a qualifying score on an Advanced Placement (AP), 


International Baccalaureate (IB), or Technical Skills Attainment (TSA) assessments and/or 
receive college credit through early college, dual enrollment, or approved dual credit courses 
meets or exceeds the state standard or demonstrates required improvement. 


2020 Target 10 Exceeding 7.5 
On Track 7.5 On Track 4 
Approaching 6 Approaching 2 
Floor 0 Floor 0 
Notes: 


e Data are obtained from the MOSIS June Enrollment and Attendance file, MOSIS June Student 
Core, October Student Assignment, Courses Completed, and Grades Earned, and from official 
testing companies (AP and IB). 

e Only dual credit courses from a Missouri institution that is complying with the Coordinating 
Board for Higher Education’s Dual Credit Policy and Principles of Good Practice for Dual Credit 
Courses will be recognized. See Appendix E. 

e See Appendix F for approved Technical Skills Attainment (TSA) assessments that can be used to 
obtain an Industry Recognized Credential (IRC). 

e Test Scores for high school level Project Lead The Way (PLTW) courses are included in the APR. 
For additional information, please see a list of approved PLTW courses. Early college measure 
PLTW assessment scale scores of six or higher are included in Standard CCR 3*4. Data are 
obtained from the official testing company. 

e When students take multiple types of tests and/or a single test multiple times or earn multiple 
credits, one metric (the highest) is used for the APR calculation. 

e LEAs whose career and technical education expansion satisfied all established criteria and 
whose application gained departmental approval are eligible for two additional points toward 
Standard 3*4. These points apply only toward this specific indicator and may not be awarded in 
excess of the ten maximum points available. 

e Dual credit courses offered within the summer school term are utilized in this calculation. The 


summer school term is considered part of the following academic year. 
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Method for calculating number of students at or above the state standard: 


Step 1 - Determine the number of students with a qualifying score on any of the approved options 
and multiply by associated point value. 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


Scores on the AP, IB, or PLTW 
exams are used as reported by 
the testing company. Scores ona 
department-approved IRC are 
used as reported in MOSIS. 
Grades earned in department- 
approved dual credit courses, 
dual enrollment, early college, 
AP courses and IB courses are 
used as reported in MOSIS. The 
metric contributing the highest 
score is used for each student. 


Unduplicated Count 


a) 


b) 


d) 


number of graduates who score 
at or above a three on an AP 
exam or who score at or above 
a four on an IB exam multiplied 
by 1.25 


number of graduates who score 
proficient on a department- 
approved IRC assessment or a 
scale score of six or higher ona 
PLTW assessment multiplied by 
one 


number of graduates who earn 
a “B” or greater ina 
department-approved dual 
credit course, dual enrollment 
course, early college course, AP 
course, or IB course multiplied 
by one 


number of graduates without a 
qualifying score or grade on an 
approved measure multiplied 
by zero 


a) 16 * 1.25 = 20 


b)12*1=12 
c)41*1=41 
d) 81*0=0 


Number of graduates scoring at or 
above the state standard 


20+12+41+0=73 


Step 2 - Divide the number of Points Earned by the number of graduates and multiply by 100 


rounded to the tenth. 
Total Points Earned Number of Graduates MPI 
73 / 150 = 0.487 100 48.7% 
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4) Status is determined by adding 
Year 1, Year 2, and Year 3 of 
the percent of graduates who 
earned a qualifying score on 
the AP, IB, IRC, or early 
college assessments, or 
earned a qualifying grade in 
dual enrollment or approved 
dual credit courses, dividing 
by three (unless three years of 
data are not available), and 
rounding to the tenth. 


58.8 + 63.7 + 48.7 =171.2 
(Year 1 + Year 2 + Year 3) /3 
171.2 /3=57.1% 


Method for calculating Progress: 


Differentiated improvement targets are set for a given LEA or school based on the two prior years’ 
performance of that LEA or school. 


Example: Calculating the Progress measure for “ABC” school district, the following example shows how 
the CCR*4 Progress measure is calculated at the district level using a rolling average: 


ABC District Year 1 Year 2 LSoienica 
(most recent year) 
Percent of students who earna 588 63.7 43.7 
qualifying score 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to 
the tenth. 


(58.8 + 63.7) /2=61.3 


Step 2 - The average percentage for Years 1 and 2 is subtracted from 100 to determine the 


CCR*4 Gap. 
Constant Years 1 and 2 Average Percent CCR*4 Gap 
100 - 61.3 = 38.7 


Step 3 - The CCR*4 Gap is used to establish Progress Targets as determined by multiplying the 
CCR*4 Gap by the associated percentage, e.g. 25% for exceeding, 15% for on track, 5% for 
approaching. 
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Table 9. Generating Targets for Progress Measure 


Years 1 and 2 Years 2 and 3 
Percent Increase 


Average Average 

* 

ald Needed Percent Progress Target 
Exceeding 38.7 : 25% = Qs 61.3 71.0-100 

On Track 38.7 * 15% = 5.8 61.3 67.1-70.9 
Approaching 38.7 . 5% = 1.9 61.3 63.2-67.0 


Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to 
the tenth. 


(63.7 + 48.7) /2=56.2 


Step 5 - The district’s Years 2 and 3 average percentage is used to determine if the district is 
exceeding, on track, or approaching the required percent increase. In this example, the ABC 
school district has a Year 2 and 3 average percentage of 56.2, which means that it is designated as 
“Floor” not meeting the Progress Targets and subsequently receives zero (0) as its Progress Score 
in CCR*4. 


Table 10. Computing the College and Career Readiness*4 Score 


Status Progress 
2020 Target = 10 Exceeding = 7.5 
: F On Track = 7.5 On Track = 4 
Points Rosstble Approaching = 6 Approaching = 2 
Floor = 0 Floor = 0 
College and Career Readiness Total: Maximum of ten points per indicator area for Status + Progress 
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MSIP 5 Performance Standard 3: Indicators 5-6 
College and Career Readiness (CCR) (K-12 LEAs only) 
SS ————| 


College and Career Readiness (K-12 Districts) — The district provides adequate post- 
secondary preparation for all students. 
5. The percent of graduates who attend post-secondary education/training or are in the military 
within six (6) months of graduating meets the state standard or demonstrates required 


improvement. 

The percent of graduates who complete career education programs approved by DESE and are 
placed in occupations directly related to their training, continue their education, or are in the 
military within six (6) months of graduating meets the state standard or demonstrates 
required improvement. 


SS 


2020 Target 10 Exceeding 7.5 
On Track 7.5 On Track 4 
Approaching 6 Approaching 2, 
Floor 0 Floor 0 
Notes: 


e Inaccordance with recent legislation, the definition of placement for graduates who complete 
approved career education programs has been expanded within MSIP. LEAs will continue to 
report “Related” and “Not Related” placement for Perkins purposes and DESE will capture both 
populations for credit. Prior year data have been collected by DESE and factor into current year 
calculations. 

e Data are obtained from the MOSIS June Enrollment and Attendance file and February Student 
Graduate Follow-up. 

oO The total number of graduates in the denominator is the sum of students 
reported as GO1 and GO3. 

e Data from the National Student Clearinghouse (NSC) are provided to LEAs prior to the due date 
for the February Student Graduate Follow-up collection. These data contain post-secondary 
enrollment records verified by participating institutions and are intended to be used as a starting 
point for the MOSIS Student Graduate Follow-Up submission. Submissions resulting in post- 
secondary participation rates that vary significantly from results obtained from NSC will not be 
accepted for MSIP 5 purposes without adequate supporting documentation. A district with a 
15% variance will receive a warning and a 25% variance will receive an error. 

e This is a lagged indicator representing graduates from the preceding year(s). 

e For placement, related questions see the Career Education Placement/Follow-Up Guidelines 
Appendix G. 
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Example of supporting data format for APR: 


Status is determined by adding Year 1, Year 2, and Year 3 of the percent of post-secondary placement 
and dividing by three rounded to the tenth. 


Post-secondary education, 
training, military and CTE Year 1 Year2 | Year3 
placement 


From 
MOSIS 
June 
Student Number of graduates 377 385 
Core and 
Enrollment 

Number of graduates who attend 

post-secondary education or 

training, are in the military, or who 
From 

complete a department-approved 
MOSIS : 

Career Education program and are 320 339 
February : ; ; 
Follow-up placed in an occupation either 

directly related or not related to 

their training within six months of 

graduating. 

85.0 88.0 


Status 


357 
333 
Percent of post-secondary 933 
placement : 


Method for calculating supporting data: 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


The percent of post-secondary 
placement is determined by 


dividing the number of graduates 


who attend post-secondary 
education or training, are in the 
military, or who participate in a 
department-approved Career 
Education program and are 
placed in an occupation either 
directly related or not related to 
their training by the number of 
graduates, and then multiplying 
by 100 rounded to the tenth. 


Unduplicated Count 


a) number of graduates who 
attend post-secondary 
education = 147 


b) number of graduates who 
attend post-secondary 
training = 118 


c) number of graduates who are 
in the military = 17 


d) number of graduates who 
complete a department- 
approved Career Education 
Program and are placed in an 
occupation either directly 
related or not related to their 
training = 57 


Number of graduates = 385 


147+ 118 + 17+ 57= 339 


385 


339 / 385 = 0.881 


Percent of post-secondary 
placement 


0.881 * 100 = 88.1% 


Method for calculating Status: 


The percent of graduates who earned a qualifying score on post-secondary placement is determined by 
dividing the number of graduates who earned a qualifying score by the number of graduates, then 
multiplying by 100 and rounded to the tenth. 


Explanations of Data 


Examples of Data 


Examples of 
Calculations 


1) The number of graduates is 
based on June Enrollment and 


Attendance Records with an 
Exit Code indicating the 
student graduated. 


number of graduates 


385 
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2) Number of graduates who 
attend post-secondary 
education or training, or are in 
the military, or who complete a 
department-approved Career 
Education program and are 
placed in an occupation either 
directly related or not related 
to their training within six 
months of graduating. 


number of graduates who earned a 
qualifying score 


339 


3) The percent of graduates 
who earned a qualifying 
score is determined by 
dividing the number of 
graduates who earned a 
qualifying score in post- 
secondary placement by the 
number of graduates, then 
multiplying by 100 rounded to 
the tenth. 


a) number of graduates = 385 


b) number of graduates who earn a 
qualifying score = 339 


339 / 385 =0.881 


0.881 * 100 = 88.1% 


4) Status is determined by adding 
Year 1, Year 2, and Year 3 of 
the percent of graduates who 
earned a qualifying score in 
post-secondary placement, 
dividing by three (unless three 
years of data are not available), 
and rounding to the tenth. 


(Year 1 + Year 2 + Year 3) /3 


85.0 + 93.3 + 88.1 = 266.4 


266.4 /3 =88.8% 


Method for calculating Progress: 


Differentiated improvement targets are set for a given LEA or school based on the two prior years’ 


performance of that LEA or school. 


Example: Calculating the Progress Measure for “ABC” school district, the following example shows how 
the CCR*5-6 Progress Measure is calculated at the district level using a rolling average: 


ABC District 
Percent of students who earn 
a qualifying score 


Year 1 
85.0 


Year 2 
93.3 


Year 3 (most recent year 


88.1 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to 


the tenth. 


(85.0 + 93.3) /2=89.2 
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Step 2 - The average percentage for Years 1 and 2 is subtracted from 100 to determine the 


CCR*5-6 Gap. 
Constant Years 1 and 2 Average Percent CCR*5-6 Gap 
100 - 89.2 = 10.8 


Step 3 - The CCR*5-6 Gap is used to establish Progress Targets as determined by multiplying the 
CCR*5-6 Gap by the associated percentage, e.g. 25% for exceeding, 15% for on track, 5% for 
approaching. 


Table 11. Generating Targets for Progress Measure 


Percent Years 1 and 2 Years 2 and 3 
Increase Average Average 
*5- 
Eero OiGap Needed Percent Progress Target 
Exceeding 10.8 . 25% = 2.7 89.2 91.9-100 
On Track 10.8 : 15% = 1.6 89.2 90.8-91.8 
Approaching 10.8 i 5% = 0.5 89.2 89.7-90.7 


Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to 
the tenth. 


(93.3 + 88.1) /2=90.7 


Step 5 - The district’s Years 2 and 3 average percentage is used to determine if the district is 
exceeding, on track, or approaching the required percent increase. In this example, the ABC 
school district has a Year 2 and 3 average percentage of 90.7, which means that it is designated as 
“Approaching” the Progress Target and subsequently receives two points as its Progress Score in 
CCR*5-6. 


Table12. Computing the College and Career Readiness*5-6 Score 


Status Progress 
2020 Target = 10 Exceeding = 7.5 
: : On Track = 7.5 On Track = 4 
Points Possible Approaching = 6 Approaching = 2 
Floor = 0 Floor = 0 
College and Career Readiness Total: Maximum of ten points per indicator area for Status + Progress 
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MSIP 5 Performance Standard 3: High School Readiness (HSR) 
(K-8 LEAs only) 
| 


High School Readiness (K-8 Districts) — The district provides adequate post-elementary 
preparation for all students. 
1. The percent of students who earn a proficient score on one (1) or more of the high school End- 


of-Course (EOC) assessments while in elementary school meets or exceeds the state standard 
or demonstrates required improvement. 


2020 Target 10 Exceeding 7.5 
On Track 7.5 On Track 4 
Approaching 6 Approaching 2 
Floor 0 Floor 0 
Notes: 


e Allavailable EOC assessments may be used toward Standard 3: High School Readiness. 

e Data are obtained from the MOSIS June Enrollment and Attendance file and from official testing 
companies. 

e Eighth grade students are defined as exiting in MOSIS data with a code of R001 Remained 
Advanced. 

e FAY does not apply to the HSR Standard. 

e For purposes of the 2017 APR,). ifa student was assessed on the Al assessment, DESE will 
substitute with a student’s prior year qualifying proficient score on the 7‘ grade mathematics 
assessment in its place. (After analysis of the 2017 assessment data, it was determined that K-8 
LEA’s did not administer the E2 assessment). 


Example of supporting data format for APR: 


Pp t—“—*~is—SCSSCSSsear't | Year2 | Year3 | Status 
From MOSIS Number of Grade 8 students 
From MOSIS Number of Grade 8 students 
dtesti who earned a qualifying score 12 15 
Ove ona MAP EOC assessment 
compan 
Percent of Grade 8 students 19.0 16.6 26.8 20.8 


earning a qualifying score 
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Method for calculating Status: 


The percent of Grade 8 students who earned a qualifying score on the MAP EOC assessments is 
determined by dividing the number of Grade 8 students who earned a qualifying score on the MAP EOC 
assessments by the total number of Grade 8 students, then multiplying by 100, and rounding to the tenth. 


Explanations of Data 


Examples of Data 
(using Year 1-Year 3) 


Examples of 
Calculations 


The number of Grade 8 students is based 
on June Enrollment and Attendance 
Records with an Exit Code indicating the 
student has advanced to Grade 9. 

The number of Grade 8 students who 
earned a qualifying score on a MAP EOC 
assessment is determined by the number of 
Grade 8 students who earned a proficient 
or advanced score on a MAP EOC 
assessment prior to advancing to Grade 9. 


number of Grade 8 students 


number of Grade 8 students 
who earned a proficient or 
advanced score on a MAP 
EOC assessment prior to 
Grade 9 


63 (Year 1) 


12 (Year 1) 


The percent of Grade 8 students who 
earned a qualifying score on the MAP EOC 
assessments is determined by dividing the 
number of Grade 8 students who earned a 
qualifying score on a MAP EOC assessment 
by the total number of Grade 8 students, 
multiplying by 100 and then rounding to 
the tenth. 

Status is determined by adding Year 1, 
Year 2, and Year 3 of the percent of Grade 
8 students who earned a qualifying score 
on a MAP EOC assessment, dividing by 
three (unless three years of data are not 
available), and rounding to the tenth. 


a) number of Grade 8 
students = 63 


b) number of Grade 8 


students who earned a 
qualifying score = 12 


(Year 1 + Year 2 + Year 3) /3 


% of “exiting” Grade 8 
students who earned a 
qualifying score = 
12 / 63 = 0.190 


0.190 * 100 = 19.0% 


19.0 + 16.6 + 26.8 = 62.4 


62.4 /3= 20.8% 


Method for calculating Progress: 


Differentiated improvement targets are set for a given LEA or school based on the two prior years’ 


performance of that LEA. 


Example: Calculating the progress measure for “ABC” school district, the following example shows how 
the progress measure is calculated at the district level: 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded to 


the tenth. 


(19.0 + 16.6) /2=17.8 
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Step 2 - The average percentage for Years 1 and 2 is subtracted from 50 to determine the 
HSR*1 Gap. 


Baseline Years 1 and 2 Average Percent HSR*1 Gap 


50 - 17.8 = 32.2 


Step 3 - The high school readiness Gap is used to establish progress targets as determined by 
multiplying the high school readiness Gap by the associated percentage, e.g., 25% for exceeding, 
15% for on track, 5% for approaching. 


Table 13. Generating Targets for Progress Measure 


HSR 


ps Increase oS Progress AMO 
P Needed 
Exceeding 32.2 * 25% = 8.1 17.8 25.9-100 
On Track 32.2 i 15% = 4.8 17.8 22.6-25.8 
Approaching 32.2 * 5% = 1.6 17.8 19.4-22.5 


Step 4 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded to 
the tenth. 


(16.6 + 26.8) /2=21.7 


Step 5 - The district’s Years 2 and 3 average percentage is used to determine if the district is 
exceeding, on track, or approaching the required percent increase. In this example, the ABC 
school district has a Year 2 and 3 average percentage of 21.7, which means that it is designated as 
“Approaching” the Progress Target and subsequently receives two points as its Progress Score in 
HSR. 


Table 14. Computing the High School Readiness Score 


Status Progress 
2020 Target = 10 Exceeding = 7.5 
‘ : On Track = 7.5 On Track = 4 
Roints Fossitle Approaching = 6 Approaching = 2 
Floor = 0 Floor = 0 
High School Readiness Total: Maximum of ten points per indicator area for Status + Progress 
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MSIP 5 Performance Standard 4: Attendance Rate 


Attendance Rate — The district ensures all students regularly attend school. 


e The percent of students who regularly attend school meets or exceeds the state standard or 
demonstrates required improvement. 


Attendance targets use the individual student’s attendance rate and set the expectation that 90% of the 
students are in attendance 90% of the time. 


aa oe Students Progress Progress Measure Description 
Attending 90% of Time 6 8 P 


2020 Target 90.0-100 Exceeding 3% increase 
On Track 7.5 85.0-89.9 On Track 4 2% increase 
Approaching 6 80.0-84.9 Approaching 2 1% increase 
Floor 0 0-79.9 Floor 0 <1% increase 
Notes: 


e Data are obtained from the MOSIS June Cycle Enrollment and Attendance file and from Core 
Data Screen 10 - School Calendar Information. 

e Using the end of the year MOSIS June Student Enrollment Attendance, attendance rate is 
determined for every student grades K-12 who is reported any time in the district, school or 
grade throughout the year. 

e Students reported as Resident I, Non-Resident, DESEG-IN, Federal Lands, and Parent Tuition 
are included. 

e Students with zero (0) hours of attendance are excluded. 

e Any time a student transfers, changes grades or changes residency status, a new attendance 
“segment” is created for the student. For the purposes of this calculation, all segments in the 
same LEA, school and grade are summed into a set of hours of attendance and absence for that 
entity. 

e Attendance targets use the individual student’s attendance rate and set the expectation that 
90% of the students are in attendance 90% of the time. 

e An individual attendance rate is calculated for each student for the amount of time (segment) 
the student is enrolled in the LEA, school and grade. Each individual rate is weighted in 
accordance with the proportion of the school year the student is enrolled in the LEA, school 
and/or grade. For example, a student who is in attendance over 90% of the time and is 
enrolled in the school for a full year would be weighted as a 1.0, whereas a student who is in 
attendance over 90% of the time and is enrolled for 522 hours in a school with a 1044 hour 
calendar would be weighted as a 0.5. 

e =Total hours enrolled is the total hours of attendance plus the total hours of absence. 

e Total calendar hours are the actual total calendar hours recorded in Core Data Screen 10. 

e Student’s proportional weight is determined by taking the total hours enrolled for the LEA or 
school and dividing by the total calendar hours rounded to the thousandth. 

e Ifastudent drops out and returns at a later date, the Stop Code may be used for reporting 
purposes. A student’s absence must exceed 20 consecutive calendar days in order to use the 
Stop Out code. 
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Method for calculating supporting data: 

The student’s attendance rate is determined by using the “hours of absence” method. This method is 
calculated by dividing the hours of attendance by the total hours enrolled, then multiplying by 100 
rounded to the tenth. 


When calculating the LEAs or schools attendance rate the proportional weight of each student is used. 
The proportional weight is determined by taking the total hours enrolled for the LEA or school and 
dividing by the total calendar hours rounded to the thousandth. 


Step 1 - Determine each student’s attendance rate and the proportion of time spent in the 
LEA, school and grade. 


Example of “hours of absence” method for the individual student enrolled in the LEA full year: 


Explanations of Calculations Examples of Data Examples of Calculations 


The hours of attendance and the | —s Attendance Hours si Hours 
hours of absence for each 

student are reported in the MOSIS | a) hours of attendance = 1,012 
June Student Enrollment and 

Attendance. b) hours of absence = 32 


1) The total hours enrolled for 
the individual student is 
determined by the sum of 1,012+32=1,044 
reported hours of attendance + 
hours of absence. 


2) The attendance rate of the 
individual student using the 
“hours of absence” method is 
determined by dividing the a) hours of attendance = 1,012 1,012 / 1,044 = 0.969 
hours of attendance for the 
individual student by the total 
hours enrolled for the b) total hours enrolled = 1,044 0.969 * 100 = 96.9% 
individual student, then 
multiplying by 100 rounded to 
the tenth. 


3) The total calendar hours is 
reported on Core Data Screen a) total calendar hours = 1,044 
10. 


4) Each student’s proportional a) hours of attendance = 1,012 
weight is determined by the 1,012 + 32 =1,044 
total hours enrolled divided b) hours of absence = 32 
by the total calendar hours 1,044 / 1,044 = 1.0 
rounded to the thousandth. c) total calendar hours = 1,044 
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Example of “hours of absence” method for the individual student enrolled in the LEA less than full 
year: 


Explanations of Calculations Examples of Data Examples of Calculations 


The hours of attendance and the | -—-AttendanceHours Hours 
hours of absence for each 

student are reported in the MOSIS | a) hours of attendance = 249 
June Student Enrollment and 

Attendance. b) hours of absence = 30 


1) The hours possible for the 
individual student is 
determined by the sum of 249 +30 =279 
reported hours of attendance + 
hours of absence. 


2) The attendance rate of the 
individual student using the 
“hours of absence” method is 
determined by dividing the 
hours of attendance for the 
individual student by the total 
hours enrolled for the 
individual student, then 
multiplying by 100 rounded to 
the tenth. 


hours of attendance = 249 249 / 279 = 0.892 


total hours enrolled = 279 0.892 * 100 = 89.2% 


3) The total calendar hours 
enrolled are reported on Core 
Data Screen 10. 


total calendar hours enrolled = 
1,012 


4) Each student’s proportional hours of attendance = 249 
weight of attendance is 249 + 30 =279 
determined by the total hours hours of absence = 30 
enrolled divided by the total 
calendar hours rounded to the calendar hours as reported on 279 / 1,012 = 0.276 
thousandth. Core Data Screen 10 = 1,012 
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Step 2 - Determine the LEA and school’s proportional attendance rate. 


Explanations of Calculations Examples of Data Examples of Calculations 


All students are included in the 
denominator. Any student with an 

attendance rate equal to or greater 

than 90% is included in the attendance Rate = 

numerator and the denominator. 90% = numerator 

Any student with an attendance 

rate less than 90% is included in all Students = denominator 

the denominator only. 


1) Using the two examples above, 
student 1 is in attendance over numerator = 1.0+0 
90% with a proportional weight 
of 1.0. Student 2 is in 
attendance less than 90% witha denominator = 1.0 + 0.263 1.0 + 0.276 =1.276 
proportional weight of 0.263. 


1.0+0=1.0 


2) The percent of students with an 
attendance rate at or above the 
state standard is determined by 1.0 / 1.276 = 0.784 
dividing the “proportion” of 
students scoring at or above the 
state standard by the 
“proportion” of students 0.784 * 100 = 78.4% 
attendance that year, and then 
multiplying by 100 rounded to 
the tenth. 
3) The district’s or school’s 
Status is determined by adding 
Year 1, Year 2, and Year 3 ofthe | (Year 1+ Year 2 + Year 3) /3 
percent of students with an 
attendance rate at or above 
the state standard. 


78.4 + 87.3 + 88.9 = 254.6 


255.4 / 3 = 84.9% 
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Method for calculating Progress: 


Improvement targets are set for LEA or schools based on the individual group’s prior two years of status. 
A 3% increase = “Exceeding”, a 2% increase = “On Track”, and a 1% increase = “Approaching”. 


Example: The following example shows how the Progress measure is calculated at the district level for a 
school district: 


Step 1 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded 
to the tenth. 


(78.4 + 87.3) /2=82.9 


Step 2 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded 
to the tenth. 


(87.3 + 88.9) /2=88.1 


Step 3 - Subtract the average of Year 1 and Year 2 from the average of Year 2 and Year 3. The 
result is the amount of Progress. 


88.1 - 82.9 =5.2 


In the example below the school district has a Progress score of 4.8% which places that district above 3% 
which results in a score of “Exceeding”. 


Table 15. Generating Standard 4: Attendance Progress 


3 Years of Attendance at or above the state standard 


Year 1 Year 2 Year 3 


78.4 87.3 88.9 
(78.4 + 87.3) /2 (87.3 + 88.9) /2 
82.9 88.1 
88.1 - 82.9 = 5.2 


Table 16. Computing the Attendance Score 


Status Progress 
2020 Target = 10 Exceeding = 7.5 
: ; On Track = 7.5 On Track = 4 
Rome Sessible Approaching = 6 Approaching = 2 
Floor = 0 Floor = 0 
Attendance Total: Maximum of ten points per indicator area for Status + Progress 
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MSIP 5 Performance Standard 5: Graduation Rate 


Graduation Rate (K-12 Districts) — The district ensures all students successfully complete high 
school. 
1. The percent of students who complete an educational program that meets the graduation 
requirements as established by the board meets or exceeds the state standard or demonstrates 


required improvement. 


Progress Measure 


Status Progress pee 
bes g Description 


If Status = Floor, 9% increase 
needed 


If Status = Approaching, 6% 
increase needed 


If Status = On Track or 2020 
Target, 3% increase needed 


2020 Target 30 92.0-100 Exceeding 22.5 


If Status = Floor, 6% increase 
needed 


If Status = Approaching, 4% 
increase needed 


If Status = On Track or 2020 
Target, 2% increase needed 


On Track 22.5 82.0-91.9 On Track 12 


If Status = Floor, 3% increase 
needed 


If Status = Approaching, 2% 
increase needed 


If Status = On Track or 2020 
Target, 1% increase needed 


Approaching 18 72.0-81.9 Approaching 6 


Floor 0 0-71.9 ‘Floor 0 < Stated increase 


High schools and LEAs with high schools are required to meet a four-, five-, six-, or seven-year Status 
Target or a combination of Status and Progress Targets for the four-, five-, six-, or seven-year rate to 
receive full credit for graduation rate on the APR. The five-, six-, and seven-year rates track students for 
up to seven years, but are otherwise calculated in the same manner as the four-year graduation rate. For 
example, the fifth-year students remain in their original cohort and that cohort is recalculated based on 
the aggregate number of students graduating with a regular diploma within a five-year timeframe. The 
four-, five-, six-, and seven-year graduation rates are calculated, and the better of the four is used to 
determine if LEAs and schools have met the graduation rate target or have shown sufficient improvement. 
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Notes: 


Graduation targets will be reviewed and revised, if necessary, every three years. 

Data are obtained from the MOSIS June Enrollment and Attendance file. 

Four-Year Adjusted Cohort Graduation Rate Definition - The four-year adjusted cohort 
graduation rate is the number of students who graduate in four years with a regular high school 
diploma divided by the number of students who form the adjusted cohort for the graduating 
class rounded to the tenth. From the beginning of 9th grade, students who are entering that 
grade for the first time form a cohort that is subsequently “adjusted” by adding any students 
who transfer into the cohort later during the 9th grade and the next three years and subtracting 
any students who transfer out, immigrate to another country, or die during that same period. 
Five-Year Adjusted Cohort Graduation Rate Definition - The five-year adjusted cohort 
graduation rate is calculated the same as the four-year with the exception that it includes both 
four- and five-year graduates in the fifth-year cohort. 

Six-Year Adjusted Cohort Graduation Rate Definition - The six-year adjusted cohort 
graduation rate is calculated the same as the four- and five-year rate with the exception that it 
includes four-, five-, and six-year graduates from the original 9th grade cohort. 

Seven-Year Adjusted Cohort Graduation Rate Definition - The seven-year adjusted cohort 
graduation rate is calculated the same as the four-, five-, and six-year rate with the exception 
that it includes four-, five-, six-, and seven-year graduates from the original 9t grade cohort. 
Graduating Attendance Centers with grades 10, 11, 12 or 11, 12 - Attendance centers which 
do not include the 9 grade will use the same calculation as those attendance centers which 
include the 9th grade with the exception of substituting the next lowest grade level taught in the 
attendance center beyond the 9% grade for the beginning of the adjusted cohort. 

The total number of graduates in the denominator is the sum of students reported as GO1 and 
GO3. 
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e Cohort Inclusion - Students are included in the LEA’s adjusted cohort when they become a 
first time 9 grader and enter the district with the following entry codes. 
$100 Stop Out: Entry 
T101 Transfer from a public school outside district but within state 
T102 Transfer from public school within district 
T103 Transfer from home school in state 
T104 Transfer from private school in state 
T105 Transfer from public school out of state 
T106 Transfer from private school out of state 
T107 Transfer from home school out of state 
T108 Transfer from drop-out 
T109 Transfer from another country 
T100 Transfer from Unknown 
R101 Remained: Advanced 
R102 Remained: Retained 
R103 Remained: Other 
R104 Remained: Changed Grade 
E100 Initial Entry 


Note: If the student is reported for the first time as a 9% grader and has an entry code of R102 - 
Remained Retained or R103 - Remained Other that student is placed in the prior year cohort based on 
the assumption that student had been retained one (1) year. 


e Cohort Exclusion - Students are removed from the LEA’s cohort if they exit the school district 
with the following exit status. 
T001 Transfer to a public school outside district but within state 
T003 Transfer to home school in state 
T004 Transfer to private school in state 
T005 Transfer to public school out of state 
T006 Transfer to private school out of state 
T007 Transfer to home school out of state 
T008 Transfer to another country 
T009 Deceased 
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Example of the four-year cohort graduation rate calculation: 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


1) The number of cohort 
members who earned a 
regular high school diploma 
by the end of the starting 
cohort’s fourth high school 
year = number of cohort 
graduates reported in the 
MOSIS June Student 
Enrollment and Attendance. 


graduates = 900 


2) The four-year “adjustments” 
are reported in the MOSIS June 
Student Enrollment and 
Attendance File. 


2013: First Time 9t Graders 
(Starting Cohort 2013 members)+ 
Transfers in - Transfers out 


1,000 +0-50=950 


2014: Cohort 2013 + Transfers in - 
Transfers out 


950 + 25 -50=925 


2015: Cohort 2013 + Transfers in - 
Transfers out 


925+ 75-25=975 


Class of 2016: Cohort 2013 + 
Transfers in - Transfers out 


975 + 50 - 25 = 1,000 


3) The four-year adjusted 
cohort is calculated based on 
reported adjustments. 


(1,000 - 50) + (25 - 50) + (75 - 25) + 
(50 - 25) 


950 - 25+50+25 =1,000 


4) The four-year adjusted 
cohort graduation rate is 
determined by dividing the 
number of cohort graduates by 
the number of first-time 9% 
graders in the starting cohort 
plus students who transfer in, 
minus students who transfer 
out, emigrate, or become 
deceased during the cohort’s 
four high school years, then 
multiplying by 100 rounded to 
the tenth. 


a) number of four-year cohort 
graduates or less = 900 


b) number of adjusted cohort 
members = 1000 


900 / 1,000 = 0.900 


0.900 * 100 = 90.0% 


5) The LEA’s or school’s Status 
is determined by adding Year 
1, Year 2, and Year 3 of the 
adjusted cohort graduation 
rate and dividing by three 
rounded to the tenth. 


(Year 1+ Year 2 + Year 3) /3 


87.3 + 88.8 + 90.0 = 266.1 


266.1 / 3 = 88.7% 
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Example of the five-year cohort graduation rate calculation: 


Explanations of Calculations 


Examples of Data 


Examples of Calculations 


1) The number of cohort members 
who earned a regular high 
school diploma by the end of 
the cohort’s fifth high school 
year is reported in the MOSIS 
June Student Enrollment and 
Attendance. 


2) The five-year “adjustments” are 
reported in the MOSIS June 
Student Enrollment and 
Attendance File. 


graduates = 920 


2012: First Time 9 Graders 
(Starting Cohort 2012 
members) + Transfers in - 
Transfers out 


1,000 +0-50=950 


2013: Cohort 2012 + 
Transfers in - Transfers out 


950 + 25 -50=925 


2014: Cohort 2012 + 
Transfers in - Transfers out 


925+ 75 -25=975 


2015: Cohort 2012 + 
Transfers in - Transfers out 


975 + 50 - 25 = 1,000 


2016: Cohort 2012 Transfers 
in - Cohort 2010 Transfers out 


1,000 +10-5=1,005 


3) The five-year adjusted cohort is 
calculated based on reported 
adjustments. 


(1,000 - 50) + (25 - 50) + 
(75 - 25) + (50 - 25)+(10 - 5) 


950-25+50+25+5=1,005 


4) The five-year adjusted cohort 
graduation rate is determined by 
dividing the number of cohort 
members who earned a regular 
high school diploma by the end of 
the cohort’s fifth high school year 
by the number of first-time 9th 
graders in the starting cohort plus 
students who transfer in, minus 
students who transfer out, 
emigrate, or become deceased 
during the cohort’s five high 
school years, then multiplying by 
100 rounded to the tenth. 

5) The LEA’s or school’s Status is 
determined by adding Year 1, 
Year 2, and Year 3 of the five- 
year adjusted cohort 
graduation rate and dividing by 
three rounded to the tenth. 


a) number of five-year cohort 
graduates = 920 


b) number of adjusted cohort 
members = 1,005 


(Year 1 + Year 2 + Year 3) /3 


920 /1005=0.915 


0.915 * 100 = 91.5% 


88.3 + 89.8 + 91.5 = 269.6 


269.6 / 3 = 89.9% 
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Method for calculating Progress: 
Improvement targets are set for LEAs and schools based on the individual group’s three year average for 
Status. 


If Status = On Track or 


If Status = Floor If Status = Approaching 2020 Target 
2020 Target = 9% 2020 Target = 6% 2020 Target = 3% 
On Track = 6% On Track = 4% OnTrack= 2% 
Approaching Target = 3% Approaching Target = 2% Approaching Target = 1% 


Example: The following example shows how the Progress Measure is calculated at the district level for a 
school district: 


Step 1 - Determine the Status of the district. In this example, the district’s three-year average 
= 89.9%, which means it is “On Track” with the Status Measure; as a result, the district’s 


rolling average targets are 3% 2020 target, 2% on track, and 1% approaching. 


Step 2 - Add the scores for Years 1 and 2 and divide by two to determine the average rounded 
to the tenth. 


(88.3 + 89.8) /2=89.1 


Step 3 - Add the scores for Years 2 and 3 and divide by two to determine the average rounded 
to the tenth. 


(89.8 +91.5) / 2 = 90.7 
Step 4 - Subtract the average of Year 1 and Year 2 from the average of Year 2 and Year 3. The 
result is the amount of Progress. In the example below the school district has a Progress Score 


of 1.6%, which places that district between 1% and 2%, which results in a score of 
“Approaching”. 


Table 17. Generating Graduation Progress 


3 Years of Graduation Rate 


Year 1 Year 2 Year 3 


88.3 89.8 91.6 


(88.3 + 89.2) /2 (89.8 + 91.5) /2 
89.1 90.7 
90.7 - 89.1 =1.6 


Table 18. Computing Graduation Rate Score 


Status Progress 

2020 Target = 30 Exceeding = 22.5 
Points Possible On Track = 22.5 On Track = 12 

Approaching = 18 Approaching = 6 

Floor = 0 Floor = 0 


Graduation Rate Total: Maximum of 30 points per indicator area for Status + Progress 
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MSIP 5 Generating the Annual Performance Report Score 


Generating the APR Score 
Once the scores for Academic Achievement, Subgroup Achievement, College and Career or High School 


Readiness, Attendance Rate and Graduation Rate have been generated, they are combined into a single 
score. The APR score is used to differentiate among LEA performance, and to make classification 
determinations of accreditation; Accredited with Distinction, Accredited, Provisional and Unaccredited 
designations. 


Table 19. Computational Table for Generating a Final Score 


Standard 1: Academic Achievement 


English 


Mathematics Science Social Studies K-12 K-8 
Language Arts 
Stans OG. ide16 | OoGetecde || GvOn.do16'| GuguGee 
Score 
EVOgress P9265 10 O29-6-42 |) Os9e6ei2. | 215-926 
Score 
erowal (=6-42 (264412 
Score 
nage Max Score: 16 Max Score: 16 | Max Score: 16 Max Score: 8 Max: 56 Max: 48 
Points 
Earned: 
Standard 2: Subgroup Achievement 
English Mathematics Science Social Studies K-12 K-8 
Language Arts 
Stats ee ee PaBeses: || OGagea | Gat 29 
Score 
Progress f2iers7 G=127<3 0292259 | Oo Bato i5 
Score 
Growth 0-2-3 0-2-3 
Score 
yeas Max Score: 4 Max Score: 4 Max Score: 4 Max Score: 2 Max: 14 Max: 12 
Points 
Earned: 
Standard 3: College and Career Readiness (K-12) and 
Standard 3: High School Readiness (K-8) 

CCR*1-3 CCR*4 CCR*5-6 HSR K-12 K-8 
hacia i675 210 | 026275 =10 | 04.6275 =10 |026-75 S40 
Score 
PrOgress Go9aH275° | Heeeda7s | H22ede 75. | HERaaa 75 
Score 
iat Max Score: 10 Max Score: 10 | Max Score: 10 Max Score: 10 Max: 30 Max: 10 
Points 
Earned: 
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Standard 4: Attendance Rate 
Standard 5: Graduation Rate 
(LEAs and Schools with Grade 12) 
Attendance Graduation K-12 K-8 

sea 0-6-75-10 0 - 18- 22.5 -30 
Score 
ee 0-2-4-75 0-6-12-225 
Score 
Possible Max Score: 10 Max Score: 30 Max: 40 Max: 10 
Points 
Points 
Earned: 
Total: 


Total Points Earned is divided by the total points possible for the LEA or school then multiplied by 100 to 
determine the percent of Points Earned rounded to the tenth. The total percent of points possible earned 
is then used at the district level to determine a district’s accreditation status. The accreditation status of 
three consecutive APRs is then used to inform district classification recommendations to the State Board 
of Education. 


Three APRs, each reflecting three years of performance data, will be used for classification 
recommendations. DESE will review a district’s 2015 APR, 2016 APR, and 2017 APR for MSIP 
5 accreditation classifications. 

No district’s accreditation may be lowered based on 2015, 2016, or 2017 English language arts 


and mathematics assessment data. 


The percent of overall points may be earned through Status, Progress, or Growth (where 
applicable). 

APR Reports and supporting reports are located in Missouri Comprehensive Data System 
Portal at http://mcds.dese.mo.gov/Pages/default.aspx. 
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Classification / Accreditation Process 


Classification / Accreditation Process 


Step 1 - DESE produces the District’s APR which provides an objective analysis of each 
district’s attainment of the MSIP 5 Performance Standards and Indicators. A district’s 
Accreditation Classification remains intact until the State Board of Education rules otherwise. 
However, the percent of overall Points Earned on the APR defines each district’s APR 
Accreditation Status that year, using one of the following accreditation categories: 


Accreditation 


Percent of Points Earned 
Levels 


Accredited with | The district earned a minimum of 90% or more of the APR points possible AND 


Distinction meets other criteria as established by the State Board of Education; 
Accredited The district earned 70% or more of the APR points possible; 
Provisionally The district earned 50% or more of the APR points possible; 
Accredited 

Unaccredited The district earned less than 50% of the APR points possible. 


Step 2 - DESE reviews each district’s accreditation status and the APR supporting data for the 

three most recent APRs to identify trends and status in performance outcomes. If data trends 

indicate that the district’s full accreditation is or may be in jeopardy, the district may be asked 
to submit its Comprehensive School Improvement Plan (CSIP) to DESE and assistance through 
the Regional School Improvement Team (RSIT) may be activated. 


Step 3 - DESE shall use the data review process described in “Step 2” to make accreditation 
classification recommendations to the State Board of Education. Recommendations will be 
made based on APR status and APR trends and may include other factors as 
appropriate, e.g. CSIP goals, previous department MSIP findings, financial status, 
and/or leadership stability. Recommendations regarding accreditation classification are 
presented to the State Board of Education for its approval. Districts are notified by DESE of 
the accreditation classification assigned by the board. 


Note: At any time the state implements a new statewide assessment system, develops new 
academic performance standards, or makes changes to the Missouri School Improvement 
Program, the first year of such statewide assessment system and performance indicators shall 
be utilized as a pilot year for the purposes of calculating a district’s APR under the Missouri 
School Improvement Program. The results of a statewide pilot shall not be used to lower a 
public school district’s accreditation (161.855.4, RSMo). 
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MSIP 5 Generating Performance Indicator Flags 


= = 


Generating Performance Indicator Flags 

Performance indicator flags identified through the accountability system are utilized to further 
distinguish among those LEAs and schools most in need of support, to identify areas in need of 
improvement, and to guide the school improvement planning. For example, one school may have an 
overall high score but may also rank in the lowest 10 percentile for a given subgroup on a given 
indicator. This low proficiency rank would be addressed in the CSIP. Similarly, schools ranking at the 90 
percentile and above for a given subgroup or grade span area for a specific indicator are spotlighted for 
high achievement. Reports are calculated annually based on the current academic year for each subgroup 
(LEA and school-level reports), grade level (school reports), and grade span (LEA reports). 


Rules for School-Level Proficiency Rate Assignment 

The percent proficient (e.g., percent with Proficient or Advanced-level achievement) is calculated for each 
subgroup - e.g., White, Black, Hispanic, Multiracial, Asian, American Indian, EL, FRL, and students with 
disabilities and grade level for each subject area, annually for the academic achievement indicators. 
School-level percent proficient values within each combination are ranked, and the 10% and 90th 
percentiles are determined. Performance at or below the 10% percentile, or at or above the 90% 
percentile, is flagged for reporting. 

e For example, in schools with a grade 3 population for which at least 30 reportable English 
language arts scores are available, grade 3 English language arts proficiency rates are calculated, 
then schools are ranked according to this measure. Those schools with a grade 3 English 
language arts proficiency rate in the bottom 10* percentile are assigned one flag. 

e Identical reporting processes are used if they meet or exceed the 90% percentile. 

e Similar reporting processes are used for school-level assignments for the college and career 
readiness, high school readiness, attendance and graduation rate indicators, except the metric 
used for the indicator (e.g., percent of students scoring at or above the state standard, attendance 
rate, graduation rate) is used in place of percent proficient. 


Rules for LEA-Level Proficiency Rate Assignment 

While the above rules specifically refer flag assignment for schools, LEAs are also reviewed for potential 
flags. For subgroup determinations, the same rules provided would be applied to LEAs in an effort to 
identify systemic issues affecting multiple schools and highlight district-wide policies contributing to poor 
or exemplary student performance. 


Additionally, flags are assigned based on grade span performance at the LEA level, rather than grade level, 
by subject area. This is accomplished by pooling district-wide assessment scores into three groupings 
based on student grade level - grades 3-5 (elementary), 6-8 (middle), and 9-12 (high school) - and 
calculating proficiency rates for each grade span/subject area combination. 
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MSIP 5 2017 Annual Performance Report Notes 
: 


Standard 1: Academic Achievement 


e See Appendix A for projected status targets through the year 2020. These targets have been 
revisited for 2015, 2016, and 2017. The accountability year begins with the summer 
administration of any EOC assessments or MAP-A. 

The State Board of Education adopted the current assessment plan in January 2014. Major points 
in the revised plan include: 

o Administer ACT® to 11‘ grade students (Please see the January 8, 2015, ACT® Statewide 
Test Administration Administrative Memo for specific guidance: 
http://dese.mo.gov/administrative-memos); 

Oo Maintain EOCs in Algebra I, Algebra II, English II, Biology, Physical Science, and American 
Government; 

oO Maintain English language arts and mathematics testing requirements for grades 3 
through 8; 

Oo Maintain Missouri developed science assessments for grades 5 and 8. 

e Only the four required EOCs (Algebra I, English I], Biology, and American Government) contribute 
to the calculation of the APR in Standards 1 and 2. Optional EOCs (all other EOCs beyond those 
listed earlier) do not factor into Standards 1 or 2. 

o Algebra II becomes the required EOC for students who have completed the Algebra I EOC 
prior to 9: grade; Geometry becomes the required EOC for students who have completed 
the Algebra I and Algebra II EOCs prior to 9% grade. 

o Both required and optional EOCs may be used toward Standard 3: High School Readiness. 

e 2017 English language arts and mathematics assessments will abide by the Hold Harmless policy, 
See page 10 for more information. 

e Once astudent has scored proficient or advanced on an EOC (EOC) assessment, DESE will remove 
duplicate proficient/advanced scores. 

e The LEA will determine which mathematics assessment, the GLA or EOC, is the most appropriate 
measure for each individual student. 

Oo Toensure a consistent metric of annual improvement is applied to the MSIP 5 APR, GLA 
scores have been removed from 2011 and 2012 mathematics data for middle school 
students who participated in both the mathematics GLA and Algebra I EOC in the same 
accountability year. 


Standard 2: Subgroup Achievement 


e The super subgroup is used for accountability determinations in the APR. When the minimum “n” 
size of 30 is not reached using a three year cumulative “pooling” of the data, no determination is 
made. 

e 2017 English language arts and mathematics assessments will abide by the Hold Harmless policy, 
See page 10 for more information. 

e For LEAs and schools participating in the CEP, the super subgroup will be the same as the “all 
students” group in Status Measures and Progress Measures. However, Growth Measures may vary 
between standard 1 and standard 2 due to the comparison of the performance in total group 
versus super subgroup. 


Standard 3: College and Career Readiness 


e Approved IRC/TSA are included in the APR. See Appendix F for approved TSA assessments that 
can be used to obtain an IRC. 
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Test Scores for high school level PLTW are included in the APR. For additional information, please 


see http://dese.mo.gov/college-career-readiness/career-education/project-lead-way. 


Standard 3: High School Readiness 


Calculation for the APR is based on three consecutive years of data. EOC tests taken in 
mathematics, science, and/or English language arts will be included in the academic achievement 
indicator, the subgroup indicator and the high school readiness indicator. If one student takes 
multiple EOC tests, the single highest score would be included in the high school readiness 
indicator. An EOC taken in social studies would only be included in the high school readiness 
indicator, as there is not a social studies indicator in the K-8 district APR. 


Standard 4: Attendance 


The Stop Out Code was added by DESE to provide districts an appropriate way to report students 
who dropped out and then returned at a later date having been out of school for unknown reasons 
an extended period of time. Data-reporting parameters have been implemented to fulfill requests 
from districts that DESE establish clear guidance for self-reported APR supporting data to ensure 
a more standardized approach across the state. The Stop Out Code may not be used unless the 
absence exceeds 20 consecutive calendar days. Districts will receive an error message for the 
use of a Stop Out Code for fewer than 20 consecutive calendar days and will not be able to certify 
their data. 


Standard 5: Graduation Rate 


The four-, five-, six-, and seven-year graduation rates are calculated, and the better of the four is 
used for APR determinations. The four-year rate could first be calculated with 2011 graduates. 
The five-year rate could first be calculated with the 2012 graduates. The six-year rate could first 
be calculated with the 2013 graduates. The seven-year rate could first be calculated with the 
2014 graduates. The 2017 APR includes three years of data for the four-, five-, six-, and seven- 
year rates. 

The seven-year adjusted cohort graduation rate is calculated the same as the four-, five-, and six- 
year rate but will include four-, five-, six-, and seven-year graduates from the original 9 grade 
cohort. 

The total number of graduates in the denominator is the sum of students reported as GO1 and 
GO3. 
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Performance Rubrics 


STANDARD 1*1 MAP ACADEMIC ACHIEVEMENT English Language Arts 


STATUS PROGRESS 
MPI Score 
(3-Year 


Average) 


Status 
Measures 


Progress 
Measures 


16 385.7-500 |Exceeding 12 


p8 | 300.0 - 370.1 |Approaching 


Floor 100.0 - 299.9 |Floor 


Level Not Determined (LND): Zero (0) points will be awarded for data when the LND is exceeded. 
Academic Achievement Total: Status + Progress OR Growth (whichever is higher). 


Progress 
Measure 
Description 


5% of NCE 
Gap increase 


3% of NCE 
Gap increase 


1% of NCE 
Gap increase 


<1% of NCE 
Gap increase 


A maximum of 16 points may be applied to the LEA or school level score. 
Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 


STANDARD 1*2 MAP ACADEMIC ACHIEVEMENT Mathematics 


STATUS PROGRESS 


Progress 
Points 
Earned 


Approaching on 300.0 - 366.6 |Approaching 


Status 
Measures 


Progress 
Measures 


Level Not Determined (LND): Zero (0) points will be awarded for data when the LND is exceeded. 
Academic Achievement Total: Status + Progress OR Growth (whichever is higher). 


Progress 
Measure 
Description 


5% of NCE 
Gap increase 


3% of NCE 
Gap increase 


1% of NCE 
Gap increase 


<1% of NCE 
Gap increase 


A maximum of 16 points may be applied to the LEA or school level score. 
Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 
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Growth 
Measures 


Exceeding 


On Track 


Growth 
Measures 


Exceeding 


On Track 


GROWTH 


Growth 
Points 
Earned 


GROWTH 


Growth 
Points 
Earned 


Growth 
Measure 
Description 
a statistically 
significant 
score>50 
not 
statistically 
significant 
growth 
estimates 
a Statistically 
significant 
score <50 


Growth 
Measure 
Description 
a Statistically 
significant 
score>50 
not 
statistically 
significant 
growth 
estimates 
a Statistically 
significant 
score <50 
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STANDARD 1*3 MAP ACADEMIC ACHIEVEMENT Science 


STATUS PROGRESS 


Progress 
Measure 
Description 


1) 
Gap increase 
0, 
Gap increase 
: : 1% of MPI 
1) 
Gap increase 


Level Not Determined (LND): Zero (0) points will be awarded for data when the LND is exceeded. 
Academic Achievement Total: Status + Progress. 

A maximum of 16 points may be applied to the LEA or school level score. 

Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 


Status Status MPI Score Progress Progress 
Measures Points Earned | (3-Year Average) Measures Points Earned 


STANDARD 1*4 MAP ACADEMIC ACHIEVEMENT Social Studies 


STATUS PROGRESS 


Status Status MET SCOPE Progress Progress Progress 
Measure 


Measures Points Earned (3-Year Measures Points Earned or 
Average) Description 


0, 
Gap increase 
0, 
Gap increase 
: : 1% of MPI 
1) 
Gap increase 


Level Not Determined (LND): Zero (0) points will be awarded for data when the LND is exceeded. 
Academic Achievement Total: Status + Progress. 

A maximum of eight points may be applied to the LEA or school level score. 

Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 
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STANDARD 2*1 MAP SUBGROUP ACHIEVEMENT English Language Arts 


STATUS PROGRESS 
MPI Score 


(3-Year 


Progress 
Measure 
Description 


0, 

Gap increase 
9, 

Gap increase 


i 0, 
Approaching 300.0 - 351.4 Approachin 7 eee NEE 
g Gap increase 
1) 
Gap increase 


Status 
Measures 


Progress 
Measures 


Level Not Determined (LND): Zero (0) points will be awarded for data when the LND is exceeded. 
Academic Achievement Total: Status + Progress OR Growth (whichever is higher). 


A maximum of four points may be applied to the LEA or school level score. 


Growth 
Measures 


Exceeding 


On Track 


GROWTH 


Growth 
Points 
Earned 


Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 


STANDARD 2*2 MAP SUBGROUP ACHIEVEMENT Mathematics 


STATUS PROGRESS 


MPI Score 
(3-Year 
Average) 


Approaching 300.0 - 348.3 |Approaching 


Progress 
Measure 
Description 


5% of NCE 
Gap increase 


Status 
Measures 


Progress 
Measures 


3% of NCE 
Gap increase 


1% of NCE 
Gap increase 


<1% of NCE 
Gap increase 


Growth 
Measures 


Exceeding 


On Track 


Level Not Determined (LND): Zero points will be awarded for data when the LND is exceeded. 


Academic Achievement Total: Status + Progress OR Growth (whichever is higher). 


A maximum of four points may be applied to the LEA or school level score. 


GROWTH 


Growth 
Points 
Earned 


Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 


Growth 
Measure 
Description 
a Statistically 
significant 
score>50 
not 
statistically 
significant 
growth 
estimates 
a statistically 
significant 
score <50 


Growth 
Measure 
Description 
a Statistically 
significant 
score>50 
not 
statistically 
significant 
growth 
estimates 
a Statistically 
significant 
score <50 


Comprehensive Guide to MSIP 5 


Page 66 


STANDARD 2*3 SUBGROUP ACHIEVEMENT Science 


STATUS PROGRESS 


Status Status MPI Score Progress Progress Progress 
Measure 


: 3-Year : 
Measures Points Earned ( Measures Points Earned Sate 
Average) Description 


1) 

Gap increase 
0, 

Gap increase 

5 : 1% of MPI 
Approaching 300.0 - 322.6 Approaching 1 
i) 
Gap increase 


Level Not Determined (LND): Zero (0) points will be awarded for data when the LND is exceeded. 
Subgroup Achievement Total: Status + Progress. 

A maximum of four points may be applied to the LEA or school level score. 

Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 


STANDARD 2*4 SUBGROUP ACHIEVEMENT Social Studies 


STATUS PROGRESS 


MPI Score Progress 


Status Status Progress Progress 


: 3-Year : Measure 
Measures Points Earned ( Measures Points Earned ae 
Average) Description 


0, 

Gap increase 
0, 

Gap increase 

; : 1% of MPI 
Approaching 300.0 - 321.8 Approaching 0.5 
1) 
Gap increase 


Level Not Determined (LND): Zero (0) points will be awarded for data when the LND is exceeded. 
Subgroup Achievement Total: Status + Progress. 

A maximum of two points may be applied to the LEA or school level score. 

Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 
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STANDARD 3*1-3 COLLEGE AND CAREER READINESS 


STATUS PROGRESS 


Percent of 


Graduates Progress 
Status Status Progress Progress 8 
Measure 


‘ Scoring At or : 
Measures Points Earned Above thé State Measures Points Earned Description 


Standard 
ty) *q_ 
Gap increase 
1) *41_ 
Gap increase 
i F 5% of CCR*1-3 
_ 0, 
Approaching pe 40.0 - 67.1% Approaching 


Gap increase 
CCR*1-3 Total: Status + Progress 
A maximum often points may be applied to the LEA or school level score. 
Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 


STANDARD 3*4 COLLEGE AND CAREER READINESS 


STATUS PROGRESS 


Percent of 
Status Status Graduates Progress Progress 
Measures Points Earned Earning a Measures Points Earned 
Qualifying Score 


Progress 
Measure 
Description 


25% of CCR*4 
Gap increase 


9 * 
Gap increase 


2020 Target 


Approaching 


5% of CCR*4 
Gap increase 
CCR*4 Total: Status + Progress 


<5% of CCR*4 
Gap increase 
A maximum often points may be applied to the LEA or school level score. 


Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 
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STANDARD 3*5-6 COLLEGE AND CAREER READINESS 


STATUS PROGRESS 


P tof P 
Status Status ueinune Progress Progress eee 
Measure 


‘ Post-seconda : 
Measures Points Earned ny Measures Points Earned Eset 
Placement Description 


1) *O_ 

2020 Target 90.0-100% | Exceeding 25% of CCR*5-6 
Gap increase 

a 


CCR*5-6 Total: Status + Progress 

A maximum of ten points may be applied to the LEA or school level score. 

*This is a lagged indicator representing graduates from the preceding year(s). 

Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 


STANDARD 3 HIGH SCHOOL READINESS (HSR) 


STATUS PROGRESS 


Status Status Peecent of High Progress Progress Progress 
School 


: . Measure 
Measures Points Earned : Measures Points Earned Se 
Readiness Description 


9 
Increase 
1) 
Increase 
aa 


Increase 


0, 
Approaching 12.0 - 18.9 Approaching 5% of HSR Gap 


increase 
os ; a 
HSR Total: Status + Progress 


A maximum often points may be applied to the LEA or school level score. 
Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 
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STANDARD 4 ATTENDANCE 


STATUS PROGRESS 


Percent of 
Status Status Students Progress Progress 
Measures Points Earned Attending 90% Measures Points Earned ele is 
Description 


Progress 
Measure 


80.0 - 84.9 Approaching 
ee ; bai 
A maximum often points may be applied to the LEA or school level score. 


Attendance Total: Status + Progress 
Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 
STANDARD 5 GRADUATION RATE 


STATUS PROGRESS 


Status Fouts Progress 
Status Five-, Six-, Progress 8 


: : Progress Measure 
Points Points ae 
Measures or Seven- Measures Description 
Earned 
Year Rate 

If Status = Floor, 9% increase 
needed 
If Status = Approaching, 
6% increase needed 
If Status = On Track or 2020 
Target, 3% increase needed 


If Status = Floor, 6% increase 
needed 
= i 0, 
On Track 22.5 | 82.0-91.9 | OnTrack 12 TStams = perbadhne 278 
increase needed 
If Status = On Track or 2020 
Target, 2% increase needed 


92.0-100 | Exceeding 


If Status = Floor, 3% increase 
needed 

If Status = Approaching, 2% 
increase needed 

If Status = On Track or 2020 
Target, 1% increase needed 


Approaching 72.0-81.9 | Approaching 


Floor 


< stated increase 


Graduation Rate*1 Total: Status + Progress 

A maximum of 30 points may be applied to the LEA or school level score. 

Four-year, five-year, six-year, and seven-year rates are calculated and the better of the four is applied to the APR. 
Status targets change annually. See the Top 10 by 20 Projected Status Targets in the Appendix. 
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Appendix A 


Top 10 by 20 Projected Status Targets 


Standards 1-5 


Standard 1: Academic Achievement Status Targets to 2020 


Projected Status Targets in English Language Arts 


Year Floor Approaching 


2013 100.0 - 299.9 300.0 - 363.8 


2014 100.0 - 299.9 300.0 - 365.4 
2015 100.0 - 299.9 300.0 - 367.0 
2016 100.0 - 299.9 300.0 - 368.6 


2017 100.0 - 299.9 300.0 - 370.1 


Projected Status Targets in Mathematics 


Year Floor Approaching 


Fane | sa00-2099 | o00-ases 


363.9 - 385.6 
365.5 - 385.6 
367.1 - 385.6 
368.7 - 385.6 
370.2 - 385.6 


355.6 - 392.7 
358.4 - 392.7 
361.1 - 392.7 
363.9 - 392.7 


366.7 - 392.7 


PAA VS Wey t= & 
385.7 - 500 
385.7 - 500 
385.7 - 500 
385.7 - 500 
385.7 - 500 


VAAN yi 
392.8 - 500 
392.8 - 500 
392.8 - 500 


392.8 - 500 


392.8 - 500 
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Projected Status Targets in Science 


Year Floor Approaching 


2017 100.0 - 299.9 300.0 - 347.6 


Projected Status Targets in Social Studies 


Year Floor Approaching 
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344.7 - 352.7 
345.5 - 352.7 
346.2 - 352.7 
347.0 - 352.7 


347.7 - 352.7 


346.6 - 374.9 


347.1 - 374.9 


347.6 - 374.9 


348.1 - 374.9 


348.6 - 374.9 


PAWAUM Fly 
352.8 - 500 
352.8 - 500 
352.8 - 500 
352.8 - 500 


352.8 - 500 


PAWWAUM Wee 
375.0 - 500 
375.0 - 500 
375.0 - 500 


375.0 - 500 


375.0 - 500 
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Standard 2: Subgroup Achievement Status Targets to 2020 


Projected Status Targets in English Language Arts 


Year Floor Approaching YAWAUM Why x-1 8 


338.9 - 385.6 385.7 - 500 


2017 100.0 - 299.9 300.0 - 351.4 351.5 - 385.6 385.7 - 500 


Projected Status Targets in Mathematics 


Year Floor Approaching YAWAUM yx 8 


339.8 - 392.7 392.8 - 500 


2017 100.0 - 299.9 300.0 - 348.3 348.4 - 392.7 392.8 - 500 
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Projected Status Targets Science 


Year Floor 


Approaching 


311.4 - 352.7 


314.2 - 352.7 


317.0 - 352.7 


319.9 - 352.7 


322.7 - 352.7 


2020 Target 
352.8 - 500 
352.8 - 500 
352.8 - 500 
352.8 - 500 


352.8 - 500 


2017 100.0 - 299.9 300.0 - 322.6 


Projected Status Targets for Social Studies 


Year Floor Approaching 


2013 100.0 - 299.9 300.0 - 311.0 
2014 100.0 - 299.9 300.0 - 313.7 
2015 100.0 - 299.9 300.0 - 316.4 


YAVWWA VS Wey 
311.1 - 374.9 375.0 - 500 
313.8 - 374.9 375.0 - 500 
316.5 - 374.9 375.0 - 500 


319.2 - 374.9 375.0 - 500 


2016 100.0 - 299.9 300.0 - 319.1 
2017 100.0 - 299.9 300.0 - 321.8 


321.9 - 374.9 375.0 - 500 
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Standard 3: College and Career Readiness Status Targets to 2020 


Projected Status Targets for College and Career Readiness*1-3 


Year Floor Approaching 


2013 0.0 - 39.9% 40.0 - 61.3% 
2014 0.0 - 39.9% 40.0 - 62.7% 
2015 0.0 - 39.9% 40.0 - 64.2% 


2016 0.0 - 39.9% 40.0 - 65.6% 
2017 0.0 - 39.9% 40.0 - 67.1% 


61.4 - 71.4% 
62.8 - 71.4% 
64.3 - 71.4% 
65.7 - 71.4% 


67.2 - 71.4% 


Projected Status Targets for College and Career Readiness*4 


Approaching 
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38.6 - 47.7% 


39.9 - 47.7% 


41.2 - 47.7% 


42.6 - 47.7% 


43.9 - 47.7% 


PAWWAUM Wei 8 
71.5 - 100% 
71.5 - 100% 
71.5 - 100% 
71.5 - 100% 


71.5 - 100% 


PAWAUM Flys 
47.8 - 100% 
47.8 - 100% 
47.8 - 100% 
47.8 - 100% 


47.8 - 100% 
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Projected Status Targets for College and Career Readiness*5-6 


Year Floor Approaching 


2017 0.0 - 69.9% 70.0 - 79.9% 


Projected Status Targets for High School Readiness 


Year Floor Approaching 


| 2018 | 00-119% | 120-189% | 
| 2019 | 0.0-11.9% | 12.0-18.9% | 
| 2020 | 00-11.9% | 120-189% | 
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80.0 - 89.9% 


80.0 - 89.9% 


80.0 - 89.9% 


80.0 - 89.9% 


80.0 - 89.9% 


19.0 - 24.9% 


19.0 - 24.9% 


19.0 - 24.9% 


19.0 - 24.9% 


19.0 - 24.9% 


2020 Target 
90.0 - 100% 
90.0 - 100% 
90.0 - 100% 
90.0 - 100% 


90.0 - 100% 


YAWA UM Wey x-1 8 
25.0 - 100% 
25.0 - 100% 
25.0 - 100% 


25.0 - 100% 


25.0 - 100% 
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Standard 4: Attendance Status Targets to 2020 


Year Floor 


Pao 
= 
Pan 
= 


Approaching 


2017 0- 79.9% 


85.0 - 89.9% 
85.0 - 89.9% 
85.0 - 89.9% 
85.0 - 89.9% 


85.0 - 89.9% 


Standard 5: Graduation Status Targets to 2020 


Year Floor 


Approaching 


2017 0- 71.9% 
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82.0 - 91.9% 


82.0 - 91.9% 


82.0 - 91.9% 


82.0 - 91.9% 


82.0 - 91.9% 


PAWAUM Flere 
90.0 - 100% 
90.0 - 100% 
90.0 - 100% 
90.0 - 100% 


90.0 - 100% 


PAWWAUM Fle 6 
92.0 - 100% 
92.0 - 100% 
92.0 - 100% 
92.0 - 100% 


92.0 - 100% 
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Appendix B 


Assessment Schedule 
Standard 1 and 2: Academic and Subgroup Achievement 


All students in grades 3 through 8 in Missouri will take the grade level assessment. English 
Language Arts and Mathematics are administered in all grades. Science is administered in fifth and 
eighth grade. A few groups of students may be exempt from certain portions or all of the 


assessment. 


Note: Both required and optional assessments may be used to earn points toward K-8 Standard 3: High School Readiness. 


Grade-Level Assessments 


English Language Arts 


Mathematics 


Science (Grades 5 and 8) 


Required End of Course (EOC) 
Assessments (5) 


Optional End of Course (EOC) 
Assessments (5) 


English II 


Algebra I 


Biology 


American Government 


Census ACT® 


English I 


Algebra II! 


Geometry? 


Physical Science 


American History 


1 Assessment used for accountability purposes when Algebra I EOC has been completed prior to 9" grade. 
2 Assessment used for accountability purposes when Algebra I and Algebra II EOCs have been completed prior to 9" grade. 


In 2016, the Missouri State Board of Education approved a schedule for implementing the Missouri 
Assessment Program (MAP) aligned to the Missouri Learning Standards (MLS) Grade-Level 


Expectations adopted in April 2016. http://dese.mo.gov/sites/default/files/am/documents/CCR- 


16-008.pdf 


aE 
Implementation Schedule 


2015-16 2016-17 2017-18 2018-19 2019-20 


English Language Arts/Matt 


English Language Arts/Mathematic 


tenet 
J sociat studios Rotel Sere 


6 Missouri 


DEPARTMENT OF ELEMENTARY & SECONDARY 


= Tests aligned to previous Missouri Learning Standards 


T Ee D U CAT | oO N a Field tests aligned to revised Missouri Learning Standards 


Tests aligned to revised Missouri Learning Standards 


eS Grade Level Expectations (Approved April 2016) 


6/2017 
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Appendix C 
Assessment Scores Matrix 
Standard 3: College and Career Readiness*1-3 


Reading for 
Information, 
Applied 
Mathematics, and 
Locating 
Information 


Armed Forces 
Algebra + Reading | Qualification 


March 2016 Test Score 


Norecord of} Norecord of No record of No record of No record of No record of 
participation} participation participation participation participation participation 


Algebra < 66 and Bronze (3) or 
Reading < 81 below 


Algebra = 66 OR . 
870 - 980 940-1090 Reading > 81 30 - 62 Silver (4) 
Algebra = 66 AND 
990 - 1180 1100-1230 Reading > 81 63 - 87 Gold (5) 
1190 - 1600 1240-1600 88 - 99 Platinum (6) 


*Based on College Board Concordance Tables. 


< 940 
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Appendix D 
Standard 3: College and Career Readiness*4 Scores Matrix 


Student Dual Credit or 
Weight Dual Enrollment 


No record of | No record of No record of No record of No record of 
participation | participation | participation or | participation or participation or 
or earn <B or earn <B score<6 Score < proficient earn <B 


Earn “B” or greater 
in department 
approved dual 

credit course or 
dual enrollment 
course 


Earn “B” or | Earn “B” or 
greater in greaterin |Exam score of >6 
department | department on approved Earn an IRC 
approved AP | approved IB PLTW 
Course Course 


Exam score of} Exam score of 


Note: Calculation of earning a “B”, remove any ‘+’ or ‘-‘ associated with the grade, and use the scale 
below. The divisor is contingent on the course time units (i.e. semester use a divisor of two, 
quarters use a divisor of four, etc.) 


Student Name: MOSIS ID: Course No. Course Name: Course Time Unit: Grade Earned: Scale: 
Smith, John 1111111111 115795 AP Statistics Semester 1 C+ A = 4.0 
Smith, John 1111111111 115795 AP Statistics Semester 2 A- B = 3.0 

C = 2.0 
Avg. grade: 2+42=6 6+2 = 3 which equals a 'B' D = 1.0 
F = 0.0 
Student Name: MOSIS ID: Course No. Course Name: Course Time Unit: Grade Earned: 
Smith, John 1111111111 134221 Physiology Semester 1 C- 
Smith, John 1111111111 134221 Physiology Semester 2 B+ 
Avg. grade: 2+325 5+2=25 which equals a 'C' 


Comprehensive Guide to MSIP 5 Page 81 


Appendix E 
Standard 3: College and Career Readiness*4 Dual Credit 


Missouri institutions complying with the Coordinating Board for Higher 
Education’s Dual Credit Policy and Principles of Good Practice for 
Dual Credit Courses 


Public Institutions Reporting Dual Independent Institutions Reporting s 
Credit Programs and Considered in * Dual Credit Programs and Se les les = 
Compliance & Considered in Compliance alalaial|s 
Columbia College (515712) V | Central Methodist University (630984) ViviviVviVv 
Crowder College (166166) V\ VJ Vv) Vv 1{V | Drury University (603541) ViviviviVv 
East Central College (130130) V|vV|v| Vv] V | Fontbonne University (038603) Vv Vv 
Jefferson College (145145) V|vV}|v |v JV | Hannibal-LaGrange University (041544) | V | V Viviv 
Lincoln University (117117) V|vV}Vv VJ V | Lindenwood University (018759) Viviviviv 
State Technical College (formally Linn Maryville University of St. Louis 

State Technical College) (508313) eae (041639) Viv iv {vy 
Metropolitan Community Colleges (161161) | V | V | V | Vv | V | Missouri Baptist University (041538) a | | 
Mineral Area College (163163) V\V}V {V1 V | Missouri Valley College (514772) ViviviviVv 
et LSOUIREEN Stace nWersIty V|vV |v |v | Vv J Park University (511931) Viv val Vv 
ee pS Vey ero peered V |v |v |v 1 V | Rockhurst University (501839) ViviviviVv 
doce nState: Halversiyy = Meet Paitis V|vV|vV |v | Vv | St. Louis University (300310) Te lay [ae | 
Missouri Western State University (160160) V\V}Vv |v] Vv | Southwest Baptist University (635440) Viviviviv 
Moberly Area Community College (162162) | V | V | Vv | Vv | V | Stephens College (005177) alo ale 
North Central Missouri College (198198) V|vV|v|V1|V¥ | Webster University (300335) Viv Vv 
Northwest Missouri State University Wentworth Military Academy & Jr. 

(118118) Viviviv |v College (054407) Sa! 
ee a Pocus ooo V\|vV|v {V1 V | Westminster College (049495) Viv 

St. Louis Community Colleges (149149) V|V|vV1|V 1 V | William Jewell College (062273) a oy 

Southeast Missouri State University 

(120120) SOU! 

State Fair Community College (126126) ViviviviVv 

Three Rivers Community College (200200) Sy ls eval 

Truman State University (122122) Viviviviv 

University of Central Missouri (121121) Sle OL lee 

University of Missouri - Kansas City 

(116117) aReRene 

University of Missouri - St. Louis (116118) SISO EP ae Te 


v= Indicates year the Missouri institutions were used for MSIP 5 accountability 
*Williams Woods University - Offers Dual Enrollment and not Dual Credit 
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Appendix F 
Standard 3: College and Career Readiness*4 
Technical Skills Attainment (TSA) /Industry Recognized Credential (IRC) 


For a complete listing of approved IRCs: 
https: //dese.mo.gov/sites /default /files /cte-irc-tsa-guidance.pdf 


Comparison Chart 


Perkins TSA MSIP 5 IRC 


Federal Reporting Requirement for Perkins 
recipients 


Optional State reporting for Districts 


Student must be a concentrator that 
completes an approved CTE program 


Student does not have to be a concentrator or 


complete a CTE program 


Reported in MOSIS 


Does not require a certificate from industry 
after successfully completing the assessment 


Reported in MOSIS 


Requires a certificate from industry after 


successfully completing the assessment 


100% of all students who are concentrators 
and complete an approved CTE program are 


required to take a TSA assessment 


Must be a career education student in an 
approved CTE program 


No requirement on the percentage of student 


who receive an IRC 


For all students 


For all secondary and postsecondary 
students enrolled in an approved CTE 
program and a Perkins recipient 


Only secondary students 


Report all (regardless of score) secondary, 
post-secondary, and adult 


Report only passing and earned credentials 
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Appendix G 


Career Education Placement/Follow-Up Guidelines 
Standard 3: College and Career Readiness*5-6 


Follow-up data is reported on the previous year’s graduates, based on the status of the graduates 
180 days following their exit from career education training. Each graduate should be reported 
in only one career education program area. Districts should collect follow-up information on 
any student who graduated high school and received credit in at least one state-approved career 
education course (excluding Exploring Agriculture, Industrial Technology, and Exploratory Family 
and Consumer Sciences (FCS) and the Family Focused courses from program code 06-04) any 
Family and Consumer Sciences course during grades 9-12. Districts should collect follow-up data 
on any student taking a credit in a state approved career education Family and Consumer Sciences 
program (program code 0704). If students completed state-approved career courses at the 
comprehensive high school and the area career center, their follow-up data should not be reported 
for both locations. The area career center is responsible for providing each sending school with the 
appropriate follow-up data for students that attend the area career center. The sending school will 
be responsible for entering that information into MOSIS. 


If the graduate is employed and continuing their education, use the following guidelines: 


A graduate attending school (full- or part-time) and employed (full- 
Employed Related | or part-time) ina field for which they were trained, should be 
reported as “employed related” (Emp Rel). 


A graduate attending school (full- or part-time) in a field for which 
they were not trained, but employed (full or part-time) ina field for 


Emplayea Related which they were trained should be reported as “employed related” 
(Emp Rel). 
A graduate attending school (full- or part-time) in a field for which 
Continuing they were trained, but not employed in a field for which they were 
Education Related | trained should be reported as “continuing education related” (Ced 
Rel). 


For additional guidance on employed related, please see http://www.missouriconnections.org. 


Note: In accordance with recent legislation, the definition of placement for graduates who 
complete approved career education programs will be expanded within MSIP. LEAs will continue 
to report “Related” and “Not Related” placement for Perkins purposes, and DESE will capture both 
populations for credit within Standard 3*5-6. 
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Appendix H 
Types of Appeals 


There are different types of appeals: 
e Score/LND (Assessment Appeal Form and cost) 
Medical Waiver (district letterhead) 
CCR data (CCR Appeal Form) 
A+ retesting (district letterhead) 
MAP-A transfers (district letterhead) 
Miscellaneous Administrative Anomalies (district letterhead) 


A+ Appeals: 
Students retesting to achieve proficient/advanced on the Algebra I assessment for A+ purposes, 


may be removed from accountability by submitting an appeal on district letterhead. Letters must 
contain the information included below in the section titled District Letterhead Requirements. 


CCR Data Appeals: 
Once the APR is released, districts have approximately one month to correct/appeal the data 


received by the various testing companies (ACT®, SAT®, ASVAB, ACT WorkKeys®, AP, IB, etc.). For 
additional information, or to obtain the form, go to 
http: //dese.mo.gov/quality-schools/accountability-data/appeals-procedure 


MAP-A Transfer Appeals: 
Students that transfer out of a district during the portfolio collection must submit a letter, on 


district letterhead, with the date the student transferred. These instructions are also included in 
the MAP-A Administration Manual. Letters must contain the information included below in the 
section titled District Letterhead Requirements. 


Medical Waiver Appeals: 
An appeal may be submitted on district letterhead for students experiencing an acute (short term) 


illness that prevents the student from receiving instructional services. Letters must contain the 
information included below in the section titled District Letterhead Requirements. 


Score /Level Not Determined (LND) Appeals: 

There is an appeal window during which LEAs may submit appeal requests. There is a cost for 
appeals that are submitted to the testing company’s for rescoring/LND. For additional information, 
or to obtain the form, go to 
http://www.dese.mo.gov/quality-schools/accountability-data/appeals-procedure 


Comprehensive Guide to MSIP 5 Page 85 


District Letterhead Requirements: 
The following information must be included in your written request on district letterhead: 


e Student Name 

MOSIS ID 

Date of birth 

Grade 

County District Code 

School Code 

Content Area 

Brief explanation of reason for appeal 
Signed by Superintendent 

Fax to: (573) 526-3045 
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Appendix I 


Missouri Growth Model Technical Documentation 
Standard 1 & 2: Academic and Subgroup Achievement 


1: INTRODUCTION 

This document describes the estimation procedure employed by the Missouri Growth Model to 
generate growth measures for Local Education Agencies (LEAs) and schools. These measures are 
reported on the MSIP 5 APR and reflect systematic differences in academic achievement gains 
compared to baseline predictions. 


It is important to note that these measures are just one gauge of effectiveness. They are not 
designed to be a measure of progress toward the state’s 2020 performance targets, for example. 
Instead, they indicate how achievement gains among similarly circumstanced students in similarly 
circumstanced LEAs or schools differ as a function of the particular LEAs or schools where students 
were enrolled when they took the MAP exams. In this way, estimates generated by the Missouri 
Growth Model are relative. 


2: DATA 

The Missouri Growth Model is estimated using individual student test results from the Missouri 
Assessment Program (MAP) exams given annually to public school students in the state of Missouri. 
Currently, the Missouri Growth Model uses data from the mathematics and English language arts 
exams administered to all students in grades three through eight. 


At the current time, a three-year rolling panel is used as the analytic data sample. For example, 
following the 2012 academic year, exam scores from 2012, 2011, and 2010 were included as 
outcome variables in the model estimation. The use of multiple years of data improves the stability 
of the growth estimates. Of course, the tradeoff in including multiple years of data in the model 
estimation is that real improvements in school and LEA quality take longer to appear in the effect 
estimates. The three-year panel strikes a balance between the goal of improving the stability of 
effect estimates and the desire to help LEAs and schools demonstrate improvements more quickly. 


2.1 Standardizing MAP Scale Scores 

Growth measures in MSIP 5 are designed to provide estimates of schooling effectiveness for units 
(LEAs or schools) as a whole. It is therefore important that the measures have a meaningful 
interpretation at the unit-level. Moreover, the generalized predictive relationship between a 
student’s exam score in a given year and his or her prior-year exam score cannot be estimated 
appropriately in cases when apparent gains may be confounded by differences in scaling from one 
grade to the next. Due to these considerations, MAP scale scores are standardized by year and 
grade prior to being submitted to the model. 

Standardization is accomplished by converting MAP scale scores to z-scores. Z-score 
standardization is commonly performed on data that exist on different scales. A z-score of zero (0) 
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represents the mean for a given subject, year, and grade. The following example explains how a z- 
score is calculated: 


Table 1: Calculation of z-scores 


Step Explanation 


1. Find the mean scale score for the given The mean (x) is the sum of the scale scores for 
assessment. Each combination of grade all students with a valid score, divided by the 


level, content area, and school yearis | number of students with a valid score (N). 
treated as a different assessment in this 


context. 
2. Find the standard deviation of the scale The formula for standard deviation is 
score for the same assessment. 


where x; is the scale score for a given student. 


3. Take the student’s scale score and If the mean is 640; the standard deviation is 
subtract the mean. Then divide by the 38; 
standard deviation. The result is the z- 
score. and the student’s actual scale score is 700; 
then: 


z= (700-640) / 38 
z= 60/38 


z=1.5789 


2.2 Method of Pairing Scores 

The model uses test score pairs for estimation. A score pair is formed by matching an exam score 
for a student tested in year t (the outcome score) to a prior exam score for the same student in the 
same subject and previous grade from year t-1 (a predictor score). As a result, scores from fourth 
grade students are the first scores that can appear as outcome scores in the model. Scores from 
students who take the exam twice at the same grade level, due to being retained in grade, do not 
generate a valid score pair for the year the retest occurred. 


The example below shows how an individual student’s exam scores are arrayed as pairs: 


Table 2: Arrangement of Data as Score Pairs 
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Standardized MAP 


Grade Level in Scale Score for Grade Level in Standardized MAP Scale 
Year t Score for Year t-1 
Year t Year t (Outcome Year t-1 j 
(Predictor Scores) 
Scores) 
2012 8 1.30 ee ee ee ees 1.10 
2011 7 1.10 6 |_—_——— 0.80 
2010 6 0.80 Se 0.60 
2009 5 0.60 


2.3 Treatment of Missing Data 

A prior-year same-subject exam score (predictor score) is required for an outcome score to be 
included in model estimation. Specifically, if a student is missing the mathematics MAP score in 
year t-1 when the outcome score in the model is the mathematics MAP score in year t, then that 
student’s score is dropped from the analysis. The same rules are used to construct the English 
language arts estimation sample, i.e., both the year t and year t-1 English language arts scores must 
be available to include the student’s score pair in the analysis. This method was chosen because the 
absence of a lagged same-subject score can be seen as conceptually problematic in a gains model. 


The model also uses prior year exam scores from the “other subject” to predict current year scores. 
For example, when a mathematics MAP score is the outcome score, a prior year English language 
arts score for the same student from the previous grade also is used as a predictor score. In cases 
where the lagged off-subject score is unavailable, the lagged off-subject score is set to zero (0), the 
standardized mean. This maximizes the amount of data included in the estimation and accounts for 
students with poor attendance during the week of examinations (a group that is likely to be non- 
random). 


This data strategy sets a student’s missing, lagged off-subject score equal to the statewide exam 
average. However, students with missing exam scores may systematically over or underperform 
relative to students that truly scored at the statewide average on the previous year off-subject exam 
(and for whom these data are available). To control for this possibility, an indicator variable 
signifying the presence of a missing score is also included in the model. Moreover, the model 
includes an interaction term to give more weight to the same-subject lagged MAP score for the 
observations where the lagged off-subject MAP score is missing, as it is now the sole source of 
empirical information about prior test performance. The full model estimation strategy is 
discussed in the next section. 
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3: MODEL SPECIFICATION 


3.1 First-Stage Predictive Model 

The estimation procedure used to measure growth consists of two steps. In the first step, 
individual students’ MAP scores, standardized by year, subject, and grade, are regressed on student 
and unit-level characteristics. The following equation is estimated using Ordinary Least Squares 
(OLS). 


Yije(x) = Bo + BrYijct-1y mM) + B2Yijee-1) (ela) + BzMissing + B,Missing 
x Vijce-1y (4) + BsMijt + BeSijt + BpGrade + BgYear + ejj¢ 


Where 


Y;jc(x) = A test score in subject x (m=math or ela=English language arts) for student i at 
unit j in year t. 


The unit component is flexibly defined and can be applied at the LEA level, school level, etc. This 
flexibility is one of the benefits of the model. Models are currently being estimated at the LEA and 
school levels only. 


Missing = A binary indicator variable where the indicator is set to one if the lagged off- 
subject MAP score is missing and is set to zero (0) otherwise. 


Missing X Y;j;(¢-1)(x) = An interaction term between the Missing indicator variable and the 
lagged same-subject MAP score. 


M;j =A binary indicator variable set to one if the student was in the building where tested 
for less than the full academic school year and zero (0) otherwise. 


Sij = A vector of variables controlling for unit-specific characteristics. 


The unit characteristics are also calculated from the MAP score records and measure average 
lagged mathematics and English language arts MAP scores, the percentage of students with missing 
lagged off-subject MAP scores (e.g., the percent missing lagged English language arts scores in the 
mathematics model), and the percentage of tested students that were in the building in which they 
were tested for less than a full school year. Note that the average lagged exam scores are based on 
the prior scores of students who took the MAP test at the unit in year t, and not on the year t-1 
scores of students that were actually in the unit at that time (although there may be substantial 
overlap between the two sets). 


Grade = A set of binary indicator variables where the indicator is set to one if the student is 
in the relevant grade when the exam was taken, while all others are set to zero . 


Year = A set of binary indicator variables where the indicator for the year when the test was 
taken is set to one, while all others are set to zero. 


These two sets of indicator variables account for differences in the testing data that are observed 
across grades and over time and that are correlated to current-year MAP scores. 
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eij, = The OLS error term from the regression. 


The model presented in equation is then estimated using statewide exam score data. The OLS 
parameter estimates (regression coefficients) for this first-stage regression are presented in the 
Parameter Estimates from First-Stage OLS chart (found at the end of this technical report). These 
estimates define the independent linear relationship between the predictor variables presented 
above and the outcome exam scores. Given these relationships, the model can then be used to 


predict each student’s outcome scores given the values of his or her predictor variables. For 
example, consider a student with the data record for one year presented in Table 3. 


Table 3: Student Exam Score Prediction Sample Data 


Variable Value 
Current-Year Math Score (z-score units) 0.226 
Prior-Year Math Score (z-score units) 0.127 
Prior-Year English Language Arts Score (z-score units) 0.675 
Missing Off-Subject (ELA) Prior-Year Score Indicator 0 
Mobility Indicator 1 
LEA Average Lagged Math Score 0.213 
LEA Average Lagged English Language Arts Score 0.011 
LEA Percent Mobile 5.12 
LEA Percent of Students with Missing Off-Subject Scores | 3.86 
Grade 4 Indicator 0 
Grade 5 Indicator 1 
Grade 6 Indicator 0 
Grade 7 Indicator 0 
2010 School Year Indicator 0 
2011 School Year Indicator 0 
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This record describes a grade-5 student who took the MAP mathematics exam in 2012 (the grade 5 
indicator is set to one, while the 2010 and 2011 school year indicators are set to zero (0). Note that 
this student also could have a data record included in the model estimation where the 4 grade 
MAP score is the outcome score and the 3" grade scores are predictors). Moreover, the student 
was not present in the school in which the exam was taken for the entire year (the mobility 
indicator is set to one) but did take the MAP exam in an LEA with above average lagged exam scores 
and a low overall percentage of mobile students. The student also has lagged exam scores available 
in both subjects (note that the missing off-subject prior-year exam indicator is set to zero). Given 
these values and the coefficients from the Parameter Estimates from First-Stage OLS chart (found at 
the end of this technical report) the following calculation is used to determine the student’s 
predicted 2012 exam score: 


¥i je (m) = Bo + BYiye-1 (mn) BoYijt-1) (ela) + B3Missing + B,Missing (2) 
x Yij(t—1) ) + BsMijt + BoSijt + B7 Grade + BgYear 


= 0.014 + (0.625)0.127 + (0.220)0.675 + (—0.077)0 + (0.043)(0 x 0.127) 
+ (—0.114)1 + (0.222)0.213 + (—0.068)0.011 + (0.004)5.12 
+ (—0.002)3.86 + (0.003)0 + (0.002)1 + (0.001)0 + (0.000)0 
+ (—0.000)0 + (0.001)0 


= 0.189. 


Hence, this student would be predicted to score 0.189 standard deviations above the mean on the 
2012 MAP mathematics grade-5 exam. 


Once the predicted scores are calculated, they are subtracted from the observed scores to generate 
residuals, which reflect the unexplained growth in student scores. For the above student, this value 
is €;;, = 0.226 — 0.189 = 0.037. In other words, the student scored higher than predicted by the 


model and would figure positively into the LEA effect estimate. 


3.2 Second-Stage Effect Model 
Once the residuals from the first-stage regression (é;;,) are calculated and captured for each 
student, they are used as the dependent variable in a second-stage regression: 


ijt = 9 - (Unit Indicator Variables) + uijjt (3) 


The residuals, é;;, , are the part of outcome test scores not predicted from students’ prior year 
scores and unit characteristics. The second-stage regression then captures how much of the 
variation in the residuals can be explained by the units under study, be it LEAs or schools. (For 
purposes of exposition, the assumption is that the units are schools throughout the rest of the 
model description). Thinking of the model in terms of the baseline prediction in stage 1, and noting 
that the dependent variable in the second stage is the student-level deviation from the baseline 
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prediction, the second-stage regression can be used to identify schools where the students 
systematically perform above or below their predicted values.1 Equation is estimated twice to 
produce two separate sets of school effect estimates - one calculated using all student residuals 


associated with each school (2 ccéieeen) and one calculated using only the student residuals from 


super-subgroup students (0, ncehieren): In both cases, the standard errors for the second-stage 
regression are calculated to be robust in the presence of heteroscedasticity and are clustered at the 
student-level to account for the fact that a single student can appear up to three times in the data, 
once for each of his/her exam score pairs included in the model. This effectively lowers the number 
of independent observations used in the estimation procedure. 


Once the effects of all schools are estimated, they are centered appropriately. For MSIP 5, Standard 
1, this is accomplished by calculating the average effect for all schools and then subtracting that 
average from each school effect. Specifically, 


x 


Osi — gsi _ gsi 
Gj = Oj uncentered Guncentered (4) 


where 651 ..ntereq is the average of the uncentered effects for all schools in the state. As a result of 
this centering, the mean value for 67% will be zero. For MSIP 5, Standard 2, the comparison group is 
the average residual for all non-super-subgroup students in the state. Hence, the centered effect 


estimate in this case is given by: 


AS2 _ fs2 _ 5 2 
0; - GF incentered Cnon-ssg- (5) 


3.3 Shrinkage and Conversion to NCE Units 

After the estimates are centered, shrinkage techniques are then applied to them to help account for 
the fact that individual school effects are measured with differing amounts of noise.3 This variation 
in the reliability of estimates is the result of a variety of factors including sample size differences 
across schools and variability in exam score measurement error across students. The shrinkage 
estimate for each school is a weighted average of that school’s centered effect estimate, 6;, and the 


overall average school effect, 6. Schools with noisy estimates have relatively more weight placed on 
the overall average, while schools with less noisy estimates have relatively more weight placed on 
the effect estimate. The weight applied to the estimate for each school j is given by the following 
formula.* 


* Also note that the second-stage regression is estimated without an intercept. This is beneficial, as it allows an 
effect and, more importantly, a corresponding standard error to be estimated for every school under 
consideration. 

* In the calculation the centered effect estimates, it is assumed that the mean value for the reference group is 
equal to the true population value, so that the standard errors for the uncentered estimates are equal to the 
standard errors for the centered effect estimates. 

> All of the procedures described in this section are performed separately on the estimates for MSIP 5 Standard 1 
and MSIP 5 Standard 2. To simplify exposition, the superscripts on the effect estimates are suppressed and a 
single, general effect estimate (8) is presented for illustration. 

* This school-specific weight, 7;, is known as the reliability ratio, and it is used to calculate the shrunken effect 


estimate in the following manner: Op cinadnneie = 70; + (1 - 74)6. 
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__ & (6) 


In (6), Gf is an estimate the overall variance of the school effects (minus estimation error) and is 
calculated as the variance of the estimated school effects, 6, minus the adjusted mean of the 
estimated variance of each individual school’s effect estimate, 6}, where 6? is the square of each 
effect estimate’s standard error. 5 


The shrunken effect estimates and the corresponding upper and lower bounds of their 95% 
confidence intervals are converted to normal curve equivalent (NCE) units via the following 
formula 


a 


9; shrunken,NCE = 50 + 21.06 6. (7) 


Additionally, the shrunken effects can be tested for statistical significance using the shrunken 
standard errors associated with the effect estimate for each school.® For both MSIP 5 Standard 1 
and 2, the test statistic is calculated via the following formula: 


a 9; shrunken —0 = 0; shrunken (8) 
; ar ra 
Oj, shrunken Oj, shrunken 


In both cases, the null hypothesis compares the shrunken effect estimate to zero. However, it is 
important to remember that the comparison group (the zero) differs by standard. For Standard 1, 
this value is simply the average statewide school effect. For Standard 2, the centering is in 
comparison to the average residual for all non-super-subgroup students in the state. 


Given the high number of student observations in each model (nearly one million in the Standard 1 
specification) and the convergence property of the t-distribution, these test statistics are then compared to 
the standard normal distribution to determine statistical significance.’ For Standard 1, significant positive 
effects indicate the school performed above the state average in a statistically distinguishable way, while 
significant negative effects indicate the school performed below the state average. School effects that are not 
statistically significant cannot be differentiated from the mean with available data. For Standard 2, significant 
positive effects indicate that the super-subgroup students in the school, on average, outperformed the non- 
super-subgroup students in the state in a statistically distinguishable way; conversely, significant negative 
effects indicate that the opposite is true. Insignificant effects indicate that the test score growth of super- 
subgroup students in the school cannot be statistically differentiated from the statewide test score growth of 
non-super-subgroup students. 


7 Specifically, the adjusted mean is calculated as — = 6}. This procedure is based on Aaronson et al. (2007), 


who use the same calculation to estimate the estimation-error variance of teacher fixed effects in their study. 

° The shrunken standard errors are simply the unshrunken standard errors multiplied by the reliability ratio, i.e. 
6; sarunken = r7G;. 

’ All statistical tests are conducted at the 0.05 significance level. 
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Parameter Estimates from First-Stage OLS 


A1 LEA Mathematics Parameter Estimates 


Intercept 

Lagged Math Exam Score (missing set to 0) 
Lagged Year ELA Exam Score (missing set to 0) 
Indicator for Missing Lagged ELA score 
(Missing Indicator)*(Lagged Math Exam Score) 
Mobility Indicator (in building less than 1 year) 
LEA Average Lagged Math Score 

LEA Average Lagged ELA Score 

LEA Percent with Missing Lagged ELA Score 
Percent Mobile in LEA (building less than year) 
Grade 4 Indicator 

Grade 5 Indicator 

Grade 6 Indicator 

Grade 7 Indicator 

Indicator for 2010 Exam Record 

Indicator for 2011 Exam Record 


n = 949224; R-squared = 0.6785 


A2 LEA English Language Arts Parameter Estimates 


Intercept 

Lagged Year ELA Exam Score (missing set to 0) 
Lagged Math Exam Score (missing set to 0) 
Indicator for Missing Lagged Math score 
(Missing Indicator)*(Lagged ELA Exam Score) 
Mobility Indicator (in building less than 1 year) 
LEA Average Lagged ELA Score 

LEA Average Lagged Math Score 

LEA Percent with Missing Lagged Math Score 
Percent Mobile in LEA (building less than year) 
Grade 4 Indicator 

Grade 5 Indicator 

Grade 6 Indicator 

Grade 7 Indicator 

Indicator for 2010 Exam Record 


Indicator for 2011 Exam Record 


Parameter 
Estimate 


0.01362 
0.62485 
0.21999 
-0.07737 
0.04281 
-0.11412 
0.22167 
-0.06764 
0.00391 
-0.00248 
0.00262 
0.00158 
0.0012 
0.0001768 
-0.0002598 
-0.00101 


Parameter 
Estimate 


0.01417 
0.60912 
0.23906 
-0.35683 
0.01142 
-0.08461 
0.27741 
-0.14185 
-0.0078 
-0.00226 
0.00143 
0.00074137 
0.00020676 
-0.00024624 
0.00023253 
-0.00058995 


Standard 
Error 


0.00179 
0.00088458 
0.00087356 

0.01435 

0.00959 

0.00296 

0.00651 

0.0074 

0.00159 
0.00020859 

0.00184 

0.00184 

0.00184 

0.00184 

0.00143 

0.00143 


Standard 
Error 


0.00182 
0.00088812 
0.0008993 
0.01782 
0.01225 
0.00301 
0.0075 
0.00665 
0.002 
0.00021131 
0.00187 
0.00187 
0.00187 
0.00187 
0.00145 
0.00145 


t-value 
7.62 
706.38 
251.83 
-5.39 
4.46 
-38.57 
34.05 
-9.13 
2.47 
-11.89 
1.42 
0.86 
0.65 
0.1 
-0.18 
-0.71 


t-value 
7.81 
685.85 
265.83 
-20.02 
0.93 
-28.12 
37 
-21.34 
-3.9 
-10.67 
0.76 
0.4 
0.11 
-0.13 
0.16 
-0.41 


P-value 
<.0001 
<.0001 
<.0001 
<.0001 
<.0001 
<.0001 
<.0001 
<.0001 
0.0137 
<.0001 
0.1558 
0.3917 
0.5156 
0.9236 
0.8555 
0.4777 


P-value 
<.0001 
<.0001 
<.0001 
<.0001 

0.351 
<.0001 
<.0001 
<.0001 
<.0001 
<.0001 
0.4448 
0.6921 

0.912 
0.8954 
0.8727 
0.6842 
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n = 948499; R-squared = 0.6677 


A3 School Mathematics Parameter Estimates 


Intercept 

Lagged Math Exam Score (missing set to 0) 
Lagged Year ELA Exam Score (missing set to 0) 
Indicator for Missing Lagged ELA score 
(Missing Indicator)*(Lagged Math Exam Score) 
Mobility Indicator (in building less than 1 year) 
School Average Lagged Math Score 

School Average Lagged ELA Score 

School Percent with Missing Lagged ELA Score 
Percent Mobile in School (building less than year) 
Grade 4 Indicator 

Grade 5 Indicator 

Grade 6 Indicator 

Grade 7 Indicator 

Indicator for 2010 Exam Record 

Indicator for 2011 Exam Record 


n = 949224; R-squared = 0.6787 


Parameter 
Estimate 


0.01358 
0.6225 
0.21849 
-0.05585 
0.03143 
-0.10448 
0.15424 
-0.00898 
-0.00421 
-0.00235 
0.00354 
0.00302 
0.00208 
0.0003843 
-7.165E-05 
-0.0008295 


Standard 
Error 


0.00167 
0.000893 
0.000879 

0.01465 

0.0096 

0.00299 

0.0048 

0.00538 
0.000557 
0.000157 

0.00184 

0.00184 

0.00184 

0.00184 

0.00143 

0.00143 


t-value 
8.15 
697.1 
248.5 
-3.81 
3.28 
-34.99 
32.13 
-1.67 
-7.55 
-14.98 
1.92 
1.64 
1.13 
0.21 
-0.05 
-0.58 


P-value 
<.0001 
<.0001 
<.0001 
0.0001 
0.0011 
<.0001 
<.0001 
0.0949 
<.0001 
<.0001 

0.055 
0.1003 
0.2572 
0.8347 
0.9599 
0.5606 
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A4 School English Language Arts Parameter Estimates 


Intercept 

Lagged Year ELA Exam Score (missing set to 0) 
Lagged Math Exam Score (missing set to 0) 
Indicator for Missing Lagged Math score 
(Missing Indicator)*(Lagged ELA Exam Score) 
Mobility Indicator (in building less than 1 year) 
School Average Lagged ELA Score 

School Average Lagged Math Score 

School Percent with Missing Lagged Math Score 
Percent Mobile in School (building less than year) 
Grade 4 Indicator 

Grade 5 Indicator 

Grade 6 Indicator 

Grade 7 Indicator 

Indicator for 2010 Exam Record 


Indicator for 2011 Exam Record 


n = 948498; R-squared = 0.6680 


Parameter 
Estimate 
0.01633 


0.60659 
0.23946 
-0.3392 
0.01396 
-0.07339 
0.22292 
-0.11017 
-0.00377 
-0.00306 
0.00223 
0.0009924 
0.0003244 
-0.0005072 
0.0001067 
-0.0007833 


Standard 
Error 
0.00169 


0.000894 
0.000908 
0.01823 
0.01228 
0.00304 
0.00548 
0.00489 
0.000748 
0.000157 
0.00187 
0.00187 
0.00187 
0.00187 
0.00145 
0.00145 


t-value 
9.65 


678.58 
263.76 
-18.6 
1.14 
-24.16 
40.71 
-22.55 
-5.03 
-19.55 
1.19 
0.53 
0.17 
-0.27 
0.07 
-0.54 


P-value 
<.0001 


<.0001 
<.0001 
<.0001 
0.2557 
<.0001 
<.0001 
<.0001 
<.0001 
<.0001 
0.2346 
0.5959 
0.8623 
0.7866 
0.9413 
0.5889 
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Glossary 


Academic Achievement Targets 

Academic achievement targets are based on the goal of improving total student proficiency levels 
on state assessments by 25 percent by 2020. Student Gap Group targets are based on the goal of 
cutting the achievement gap in half for students in historically under-performing subgroups (black, 
Hispanic, FRL, students with disabilities, and English language learners). 


Accountability Information 

Beginning with the 2012-13 school year, accountability reports changed significantly as a result of 
Missouri’s approval of the fifth version of the Missouri School Improvement Program (MSIP 5) and 
approval from the U.S. Department of Education for flexibility in implementing certain No Child Left 
Behind (NCLB) requirements. This allows for implementation of a single aligned system. The MSIP 
5 APRs include a "high needs" subgroup that represents an unduplicated count of all students ina 
school or district belonging to at least one of the following individual subgroups: students with 
disabilities, English language learners, low-income students, black students, and/or Hispanic 
students. 


Adjusted Cohort Graduation Rates 


All groups (districts, schools, and subgroups) are expected to make steady progress toward a goal 
of 92 percent for the five-year cohort graduation rate by 2020. 


Annual Benchmark Target (On Track) 
The target for the group in the current year needed for the group to remain on track toward 
reaching the Top 10 by 2020 goal. 


Annual Map Performance Index (MPI) 


All MAP assessment results from a single accountability year and for a single subject/content area 
are combined when generating the annual LEA, school, or student group MPI. 


Full Academic Year 

LEAs are required to test all enrolled students. All scores are reported but only scores of those 
students who have been enrolled a “Full Academic Year” in an LEA and/or building will be included 
in the calculation for the APR score. A full academic year is defined as any student who is enrolled 
from the last Wednesday in September through the MAP administration, without transferring out of 
the LEA or building for a significant period of time and re-enrolling. A significant period is 
considered “one day more than half of the eligible days between the last Wednesday in September 
and the test administration”. This applies to each level independently. For example, a student who 
is coded as “In building less than a year” but was in the LEA a full academic year is excluded from 
the building totals but is included in the LEA totals. 


Hold Harmless 

The 2017 APR Summary Report (Page 2) will include the actual Points Earned for the 2017 
calculation (Points Earned) and, if appropriate, will include half of the difference in points between 
the 2017 actual calculation and the “call” for the 2015 or 2016 APR (Hold Harmless Adjustment), 
whichever is highest. The Points Earned and the Hold Harmless Adjustment will be summed for the 
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Adjusted Total Points Earned. The same calculation process will be followed for Standard 1 
Academic Achievement and Standard 2 Subgroup Achievement. Please refer to Administrative 
Memo QS-17-004 for additional information. 


Example: An LEA receives twelve points in Standard 1 English language arts in 2017, after having 
earned nine points in 2014, 12 points in 2015, in this case, DESE subtract the current Points Earned 
from the highest of the 2015 or 2016 “call”. This number will be divided by 2 to generate the Hold 
Harmless Adjustment of 2. 


Level Not Determined (LND) 

When an Accountable student does not receive a valid test score, the student receives a “Level Not 
Determined” in place of an achievement level score. The percent for LND may not exceed five 
percent, as all LEAs and schools are required to assess at least 95 percent of their students on the 
assessments required by the MAP. 


MAP Achievement Levels and MPI Point Values 

Student performance on tests administered through the MAP is reported in terms of four 
achievement levels; below basic, basic, proficient and advance. The levels of achievement describe 
a pathway to proficiency. Numeric values are assigned to each of the achievement level scores as 
follows when calculating the MPI: 


Below Basic 1 
Basic 3 
Proficient 4 
Advanced 5 


MAP Performance Index (MPI) 

MPI is used to develop scores within the Status and Progress metrics and to set academic 
achievement targets for LEA, school and student group achievement. Student performance on tests 
administered through the MAP is reported in terms of four achievement levels (below basic, basic, 
proficient, and advanced) that describe a pathway to proficiency. The MPI is a single composite 
number that represents the MAP assessment performance of every student by awarding points to 
each student based on the four achievement levels. The points for all students in the LEA, school, 
or student group in a subject area are summed together, divided by the number of students in the 
group being measured and then multiplied by 100. The result is the MPI for that group and subject. 


MPI (Three-year) 

The annual MPIs from the three most recent years are averaged and the mean, the three-year MPI, 
is used to determine whether the LEA, school, or subgroup has reached the 2020 target, is on track 
to reaching the 2020 target, is approaching the annual benchmark or is substantially not meeting 
the achievement targets set for the MAP content area. 


MPI (Cumulative) 

LEAs, schools, and subgroups must have an average of at least 30 Accountable students in the group 
being measured in a given content area over a three year period in order to generate scores for 
accountability. If this is not possible, the status measure is calculated by “pooling” three years of 
data and summing the number of Accountable students and the numbers of students in each 
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achievement level across the three year period; the “pooled” count is used in the calculation used 
for determining Status and is referred to as the Cumulative MPI. 


N 
N is the number of students whose results are included in the calculation for a given student group. 


Normal Curve Equivalent (NCE) 
Normal Curve Equivalents are used in the calculation of Progress for English language arts and 
mathematics contents. For more information, see Appendix I. 


Participation Rate 

All LEAs and schools are required to assess at least 95 percent of their students and subgroups on 
the assessments required by the Missouri Assessment Program. Regardless of performance, zero 
(0) APR points are awarded to a content area when the rate falls below 95 percent. 


Progress 

Differentiated improvement targets are set for LEAs, schools, and subgroups based on the 
individual group’s two prior years of data. This method measures improvement by comparing two- 
year averages of data and setting targets through an MPI Gap or percent of required improvement. 
Year 1 and 2 are averaged, and years 2 and 3 are averaged; the averages are then compared to 
determine the amount of improvement. When three years of data are not available, (e.g., anew 
school is established) the available years will be used for reporting purposes. Differentiated 
improvement targets are set for LEAs, schools, and subgroups based on the individual group’s two 
prior years achievement. 


Status 

Status is a measurement of the LEA’s or school’s level of achievement based upon the specific 
calculation of a standard. Status is divided into four levels; the 2020 target, on track, approaching, 
and floor. 


Student subgroups 

School and district accountability determinations are made for the "all students" group and for the 
“super subgroup”. Determinations are made for LEAs and schools that serve 30 or more students 
and for super subgroups of 30 or more students in a single accountability year. Multiple years of 
data are used for LEAs or buildings with fewer than 30 students. LEA and school reports are 
produced for the “all students” group and for up to nine additional subgroups: Asian/Pacific 
Islander, black, Hispanic, American Indian, white, multi-racial, students with disabilities, English 
language learners, and low income students. 


Super subgroup 

The new high needs group is an unduplicated count of all students in an LEA or school belonging to 
at least one of the following individual subgroups: black, Hispanic, students with disabilities, 
English language learners, or low-income students (eligible for free/reduced price school lunch 
(FRL)). The subgroups were selected based upon a review of the state’s student achievement data. 
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Acronyms 


A test used for college admissions, indicating a 


ACT® ACT® student’s mastery of the core academic 
subjects. Scores range from 1 to 36. 
ACT A job skills assessment that helps employers 
ACT WorkKeys® select, hire, train, develop, and retain a high- 
WorkKeys® 
performance workforce. 
Meaningful goals that are used to guide and 
AMOs Annual Measurable Objectives support improvement efforts of LEAs and 
schools. 
Classes available for which students may 
AP Advanced Placement receive college credit upon passing the 
advanced placement exam. 
A report that reflects MSIP 5 Performance 
APR Annual Performance Report Standards results for districts and buildings 


used for planning and state accountability 
determinations. 


Armed Services Vocational 


ASVAB Aptitude Battery 


The ASVAB is a multiple-aptitude battery test 
that measures developed abilities and helps 
predict future academic and occupational 
success in the military. 


CCR College and Career Readiness 


A high school graduate with the necessary 
English and mathematics knowledge and 
skills—including, but not limited to, reading, 
writing, communications, teamwork, critical 
thinking, and problem solving—either to 
qualify for and succeed in entry-level, credit- 
bearing college courses without the need for 
remedial coursework, or in postsecondary job 
training for their chosen career (i.e. 
technical/vocational program, community 
college, apprenticeship, or significant on-the- 
job training). 


COMPASS® | COMPASS® 


Comprehensive School 


ad Improvement Plan 


A computer-adaptive college placement test 
that evaluates students’ skill levels in reading 
writing skills, writing essay, mathematics, and 


English as a second language. 


A local board-approved plan that focuses on 
the improvement of the district's student 
achievement levels, programs, and services. 


CTE Career and Technical Education 


Appropriate courses of career and technical 
programs of study designed to improve the 
academic and technical skills of students 
participating in CTE programs through 
integration and provide students with strong 
experience in, and understanding of, all 
aspects of an industry. 
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The term English language learners refers to 
students who were not born in the U.S. or 
whose native language is a language other 
than English. 


Annual assessment of English proficiency of 
all students with limited English proficiency. 


EL English learners 


ELP English language proficiency 


EOC assessments are criterion-referenced 
tests that are delivered to typically middle and 
EOC EOC assessments high school students when the Course-Level 
Expectations for a particular course have been 
covered, 
Applied to Standards 1 and 2- (From 
Understanding your AYP 11-12) Student who 
is enrolled from the last Wednesday in 
September through the MAP administration, 
FAY Full Academic Year without transferring out of the building or 
district/LEA for a significant period of time 
(one day more than half of the eligible days 
between the last Wednesday in September 
and the test administration) and re-enrolling. 
Students may qualify for a free or reduced 
FRL Free/Reduced priced lunch priced lunch if their household falls within the 
limits of the federal income chart. 


Grade-Level Assessments are augmented 
norm-referenced tests that are delivered 

GLA Grade-Level Assessments annually each spring in communication arts 
and mathematics for grades 3-8, and science 
for grades 5 and 8. 

International Baccalaureate is a rigorous 
academic program of studies designed to offer 
students a curriculum that will prepare them 
IB International Baccalaureate for universities around the world and is 
sponsored by the International Baccalaureate 
Organization (IBO) based in Geneva, 
Switzerland. 

A written statement that is developed, 
reviewed, and revised in accordance with 
Individualized Education Program | IDEA fora particular child with a disability as 
defined by IDEA and addresses the child’s 
unique needs as related to education. 

A portable, recognized credential (tangible 
evidence) that validates an individual has 
successfully demonstrated skill competencies 
IRC Industry Recognized Credit in a core set of content and performance 
standards in a specific set of work-related 
tasks, single occupational area, or a cluster of 
related occupational areas. 


IEP 
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LEA Local Education Agency 


LND Level Not Determined 


The term for public elementary and secondary 
school districts and other elementary and 
secondary schools operated at public expense 
and under a publicly appointed or elected 
board. 

The percent of students for whom the district 
is accountable but do not receive a valid MAP 
score in a subject or content area. 


MAP Missouri Assessment Program 


The statewide student assessment program 
developed in response to adoption of the 
Outstanding Schools Act in 1993 (Section 
160.518, RSMo). 

(grade-level, EOC, and MAP-A) 


MAP-A Map-Alternate 


Missouri's Alternate Assessments for students 
with the most severe cognitive disabilities. 


MLS Missouri Learning Standards 


The Missouri Learning Standards define the 
knowledge and skills students need in each 
grade level and course for success in college, 
other post-secondary training and careers. 
These expectations are aligned to the Show- 
Me Standards, which define what all Missouri 
high school graduates should know and be 
able to do. 


MPI MAP Performance Index 


The MPI is a single composite number that 
represents the MAP assessment performance 
of every student by awarding points to each 
student based on the four achievement levels. 
The MPI is a calculation used to determine 
whether the LEA, school, or subgroup is 
meeting the 2020 target, is on track to 
meeting the 2020 target, is approaching the 
annual benchmark, or is substantially not 
meeting the state performance targets. 


The fifth version of the Missouri 


i? School Improvement Program 


A system of accountability used by the State of 
Missouri that holds districts accountable for 
student achievement. 


National Assessment of 


ner Educational Progress 


A nationally representative and continuous 
assessment of what America’s students know 
and can do in various subject areas. It is 
commonly known as the nation’s report card. 


PLTW Project Lead the Way 


A high school program that provides students 
with real-world learning and hands-on 
experience. The program is for students 
interested in engineering, biomechanics, 
aeronautics, biomedical sciences and other 
applied math and science arenas. 


PPOS Personal Plan of Study 


A student’s scope and sequence of coursework 
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and co-curricular experiences based on 
chosen educational and career goals; relies on 
the school’s implementation of a Program of 
Study. 


SAT® 


SAT® 


A standardized test designed to assess 
academic readiness for college, measuring the 
skills required for success in the 21st century. 


SEA 


State Education Agency 


The term for the state agency with primary 
responsibility for elementary and secondary 
education in a state (in Missouri, the 
department of Elementary and Secondary 
Education). 


TSA 


Technical Skill Attainment 


A technical skill assessment measures skill 
proficiency of Career and Technical Education 
(CTE) students who are concentrators (a 
student who has earned three or more 
sequential credits in any state-approved CTE 
program grades 9-12) and has completed an 
approved CTE program. (It is not intended to 
be taken after every course). 
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It is the policy of the Missouri Department of Elementary and Secondary Education not to discriminate on the 
basis of race, color, religion, gender, national origin, age, or disability in its programs or employment practices 
as required by Title VI and VII of the Civil Rights Act of 1964, Title IX of the Education Amendments of 1972, 
Section 504 of the Rehabilitation Act of 1973, the Age Discrimination Act of 1975 and Title II of the Americans 
with Disabilities Act of 1990. Inquiries related to Department employment practices may be directed to the 
Jefferson State Office Building, Human Resources Director, 8th floor, 205 Jefferson Street, P.O. Box 480, Jefferson 
City, Missouri 65102-0480; telephone number (573) 751-9619 or TYY (800) 735-2966. Inquiries related to 
Department programs and to the location of services, activities, and facilities that are accessible by persons with 
disabilities may be directed to the Jefferson State Office Building, Office of the General Counsel, Coordinator-Civil 
Rights Compliance (Title VI/Title IX/504/ADA/Age Act), 6th Floor, 205 Jefferson Street, P.O. Box 480, Jefferson 
City, MO 65102-0480; telephone number (573) 526-4757 or TTY (800) 735-2966, civilrights@dese.mo.gov. 
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